Max level shown:
12026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 79 reason = Timeout
22026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
32026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
42026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
62026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 27 reason = Timeout
72026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
92026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
102026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
112026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 29 reason = Timeout
122026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 36 reason = Timeout
132026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
142026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
152026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
162026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
172026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
182026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
192026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
202026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
212026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
222026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
232026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
242026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
252026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
262026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 14 reason = Timeout
272026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
282026-10-29T02:45:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
292026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
302026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
312026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
322026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
332026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
342026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
352026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
362026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
372026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 14 reason = Timeout
382026-10-29T02:45:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
392026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
402026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 14 reason = Timeout
412026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
422026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
432026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
442026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
452026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
462026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
472026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
482026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
492026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
502026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
512026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
522026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
532026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
542026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
552026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
562026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
572026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
582026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
592026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
602026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
612026-10-29T02:45:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 405341636 } })
622026-10-29T02:45:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 405360586 } })
632026-10-29T02:45:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 405363776 } })
642026-10-29T02:45:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
652026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
662026-10-29T02:45:03.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
672026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9b29d56-d759-4c56-bf1f-cb9725407ba4", "content-length": "50", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
682026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.44539ms iteration = 14 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
692026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f8411f0-52ec-44dd-8052-767887a7adb4", "content-length": "50", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
702026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
712026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
722026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
732026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "71bda83c-7fd6-484d-a824-c70682d659e6", "content-length": "681", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
742026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
752026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
762026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
772026-10-29T02:45:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
782026-10-29T02:45:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
792026-10-29T02:45:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
802026-10-29T02:45:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
812026-10-29T02:45:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
822026-10-29T02:45:03.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
832026-10-29T02:45:03.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842026-10-29T02:45:03.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852026-10-29T02:45:03.730ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 408208385 } })
862026-10-29T02:45:03.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
872026-10-29T02:45:03.731ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
882026-10-29T02:45:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.293089ms iteration = 14 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
892026-10-29T02:45:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
902026-10-29T02:45:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
912026-10-29T02:45:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.569926ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
922026-10-29T02:45:03.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
932026-10-29T02:45:03.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
942026-10-29T02:45:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
952026-10-29T02:45:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
962026-10-29T02:45:03.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
972026-10-29T02:45:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
982026-10-29T02:45:03.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
992026-10-29T02:45:03.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1002026-10-29T02:45:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
1012026-10-29T02:45:03.736ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
1022026-10-29T02:45:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1032026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
1042026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
1052026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
1062026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
1072026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
1082026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
1092026-10-29T02:45:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
1102026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
1112026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
1122026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
1132026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1142026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1152026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
1162026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1172026-10-29T02:45:03.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1182026-10-29T02:45:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1192026-10-29T02:45:03.739ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
1202026-10-29T02:45:03.739ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 13.130553ms iteration = 27 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
1212026-10-29T02:45:03.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1222026-10-29T02:45:03.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232026-10-29T02:45:03.741ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6dd4d226-8a31-450a-9cfd-dff1b7e05b0a original_time_started = 2026-10-29 02:44:35.189368 UTC
1242026-10-29T02:45:03.741ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 15.244047ms iteration = 36 status = {"Loaded":{"collection_id":"6dd4d226-8a31-450a-9cfd-dff1b7e05b0a","time_loaded":"2026-10-29T02:45:03.726719937Z","time_started":"2026-10-29T02:44:35.189368Z"}}
1252026-10-29T02:45:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
1262026-10-29T02:45:03.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1272026-10-29T02:45:03.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1282026-10-29T02:45:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1292026-10-29T02:45:03.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1302026-10-29T02:45:03.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1312026-10-29T02:45:03.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1322026-10-29T02:45:03.747ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1332026-10-29T02:45:03.747ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1342026-10-29T02:45:03.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1352026-10-29T02:45:03.748ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8082bda4-51fd-4302-962f-d64f3b4a107f", "content-length": "372", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
1362026-10-29T02:45:03.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1372026-10-29T02:45:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1382026-10-29T02:45:03.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1392026-10-29T02:45:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
1402026-10-29T02:45:03.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1412026-10-29T02:45:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
1422026-10-29T02:45:03.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1432026-10-29T02:45:03.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1442026-10-29T02:45:03.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1452026-10-29T02:45:03.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 111.366625ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
1462026-10-29T02:45:03.841ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
1472026-10-29T02:45:03.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
1482026-10-29T02:45:03.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.385899ms iteration = 40 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
1492026-10-29T02:45:03.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
1502026-10-29T02:45:03.846ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
1512026-10-29T02:45:03.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1522026-10-29T02:45:03.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
1532026-10-29T02:45:03.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1542026-10-29T02:45:03.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1552026-10-29T02:45:03.847ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 121.26376ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
1562026-10-29T02:45:03.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.941926ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1572026-10-29T02:45:03.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1582026-10-29T02:45:03.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1592026-10-29T02:45:03.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1602026-10-29T02:45:03.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1612026-10-29T02:45:03.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1622026-10-29T02:45:03.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1632026-10-29T02:45:03.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1642026-10-29T02:45:03.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 127.791407ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
1652026-10-29T02:45:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1662026-10-29T02:45:03.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1672026-10-29T02:45:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1682026-10-29T02:45:03.859ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1692026-10-29T02:45:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
1702026-10-29T02:45:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1712026-10-29T02:45:03.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1722026-10-29T02:45:03.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1732026-10-29T02:45:03.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1742026-10-29T02:45:03.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1752026-10-29T02:45:03.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762026-10-29T02:45:03.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1772026-10-29T02:45:03.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
1782026-10-29T02:45:03.869ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1792026-10-29T02:45:03.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1802026-10-29T02:45:03.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1812026-10-29T02:45:03.869ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1822026-10-29T02:45:03.870ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832026-10-29T02:45:03.871ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
1842026-10-29T02:45:03.871ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
1852026-10-29T02:45:03.871ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0e39cb6-6ddf-4aa1-98ca-7c0360f62f27", "content-length": "81", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
1862026-10-29T02:45:03.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
1872026-10-29T02:45:03.874ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
1882026-10-29T02:45:03.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
1892026-10-29T02:45:03.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
1902026-10-29T02:45:03.876ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
1912026-10-29T02:45:03.876ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1922026-10-29T02:45:03.877ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1932026-10-29T02:45:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
1942026-10-29T02:45:03.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1952026-10-29T02:45:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
1962026-10-29T02:45:03.877ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
1972026-10-29T02:45:03.877ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 151.05815ms iteration = 29 status = {"Loaded":{"time_loaded":"2026-10-29T02:45:03.726710887Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
1982026-10-29T02:45:03.880ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
1992026-10-29T02:45:03.880ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
2002026-10-29T02:45:03.880ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfb0eee0-c1d5-428a-801e-425daf8ac902", "content-length": "81", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
2012026-10-29T02:45:03.883ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
2022026-10-29T02:45:03.883ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 156.442932ms iteration = 79 status = {"config_updated":false}
2032026-10-29T02:45:03.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2042026-10-29T02:45:03.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2052026-10-29T02:45:03.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062026-10-29T02:45:03.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2072026-10-29T02:45:03.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2082026-10-29T02:45:03.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2092026-10-29T02:45:03.928ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2102026-10-29T02:45:03.928ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2112026-10-29T02:45:03.928ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3076fc16-9e2d-4b3a-983f-2fdbf0c121ed", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
2122026-10-29T02:45:03.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2132026-10-29T02:45:03.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2142026-10-29T02:45:03.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2152026-10-29T02:45:03.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2162026-10-29T02:45:03.940ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
2172026-10-29T02:45:03.940ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
2182026-10-29T02:45:03.941ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf66d1ea-d2da-4832-bc55-21a05027e0d6", "content-length": "81", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
2192026-10-29T02:45:03.941ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
2202026-10-29T02:45:03.941ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 214.311615ms iteration = 14 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
2212026-10-29T02:45:03.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2222026-10-29T02:45:03.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2232026-10-29T02:45:03.948ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2242026-10-29T02:45:03.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2252026-10-29T02:45:03.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2b234faf-68a3-4c66-9262-23ee126ff810", "date": "Thu, 29 Oct 2026 02:45:03 GMT"} })
2262026-10-29T02:45:03.948ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 221.693488ms iteration = 21 status = {}
2272026-10-29T02:45:03.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2282026-10-29T02:45:03.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2292026-10-29T02:45:03.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 229.446469ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2302026-10-29T02:45:03.959ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2312026-10-29T02:45:03.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2322026-10-29T02:45:03.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2332026-10-29T02:45:03.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 235.055676ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2342026-10-29T02:45:03.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
2352026-10-29T02:45:03.962ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362026-10-29T02:45:03.966ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2372026-10-29T02:45:03.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 239.936287ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2382026-10-29T02:45:03.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2392026-10-29T02:45:03.967ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2402026-10-29T02:45:03.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2412026-10-29T02:45:03.968ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2422026-10-29T02:45:03.968ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2432026-10-29T02:45:03.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2442026-10-29T02:45:03.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
2452026-10-29T02:45:03.972ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
2462026-10-29T02:45:03.972ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 245.439931ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2472026-10-29T02:45:03.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2482026-10-29T02:45:03.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
2492026-10-29T02:45:03.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502026-10-29T02:45:03.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2512026-10-29T02:45:03.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2522026-10-29T02:45:03.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
2532026-10-29T02:45:03.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542026-10-29T02:45:03.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2552026-10-29T02:45:03.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2562026-10-29T02:45:03.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
2572026-10-29T02:45:04.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2582026-10-29T02:45:04.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592026-10-29T02:45:04.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 306.375528ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2602026-10-29T02:45:04.037ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2612026-10-29T02:45:04.037ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2622026-10-29T02:45:04.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 310.938323ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2632026-10-29T02:45:04.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2642026-10-29T02:45:04.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2652026-10-29T02:45:04.041ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
2662026-10-29T02:45:04.041ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 314.603689ms iteration = 14 status = {"incomplete_bootstore_configs":[]}
2672026-10-29T02:45:04.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
2682026-10-29T02:45:04.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b488538-b44c-42fd-b2ee-0cffd5815e14", "content-length": "691", "date": "Thu, 29 Oct 2026 02:45:04 GMT"} })
2692026-10-29T02:45:04.130ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
2702026-10-29T02:45:04.130ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
2712026-10-29T02:45:04.130ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
2722026-10-29T02:45:04.130ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 397.644155ms iteration = 14 status = {}
2732026-10-29T02:45:04.133ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 407.311426ms iteration = 27 status = {"disks_added":0,"errors":[]}
2742026-10-29T02:45:08.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 80 reason = Timeout
2752026-10-29T02:45:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
2762026-10-29T02:45:08.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
2772026-10-29T02:45:08.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782026-10-29T02:45:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
2792026-10-29T02:45:08.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
2802026-10-29T02:45:08.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
2812026-10-29T02:45:08.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
2822026-10-29T02:45:08.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.534718ms iteration = 80 status = {"config_updated":false}
2832026-10-29T02:45:10.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 131 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = e832294c-478d-43f3-bf33-59628c568298 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
2842026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 81 reason = Timeout
2852026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
2862026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
2872026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
2882026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2892026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2902026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
2912026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
2922026-10-29T02:45:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2932026-10-29T02:45:13.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2942026-10-29T02:45:13.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952026-10-29T02:45:13.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2962026-10-29T02:45:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2972026-10-29T02:45:13.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.576225ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2982026-10-29T02:45:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2992026-10-29T02:45:13.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3002026-10-29T02:45:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3012026-10-29T02:45:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
3022026-10-29T02:45:13.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3032026-10-29T02:45:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3042026-10-29T02:45:13.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
3052026-10-29T02:45:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.284463ms iteration = 81 status = {"config_updated":false}
3062026-10-29T02:45:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3072026-10-29T02:45:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3082026-10-29T02:45:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3092026-10-29T02:45:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
3102026-10-29T02:45:13.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3112026-10-29T02:45:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3122026-10-29T02:45:13.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
3132026-10-29T02:45:13.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.22288ms iteration = 41 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
3142026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 82 reason = Timeout
3152026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 37 reason = Timeout
3162026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3172026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
3182026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 28 reason = Timeout
3192026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
3202026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 30 reason = Timeout
3212026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
3222026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
3232026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
3242026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3252026-10-29T02:45:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
3262026-10-29T02:45:18.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3272026-10-29T02:45:18.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282026-10-29T02:45:18.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3292026-10-29T02:45:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3302026-10-29T02:45:18.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
3312026-10-29T02:45:18.732ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
3322026-10-29T02:45:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
3332026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
3342026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
3352026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
3362026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
3372026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
3382026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
3392026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
3402026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3412026-10-29T02:45:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3422026-10-29T02:45:18.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
3432026-10-29T02:45:18.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.048018ms iteration = 30 status = {"Loaded":{"time_loaded":"2026-10-29T02:45:18.726256452Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
3442026-10-29T02:45:18.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6dd4d226-8a31-450a-9cfd-dff1b7e05b0a original_time_started = 2026-10-29 02:44:35.189368 UTC
3452026-10-29T02:45:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 9.897255ms iteration = 37 status = {"Loaded":{"collection_id":"6dd4d226-8a31-450a-9cfd-dff1b7e05b0a","time_loaded":"2026-10-29T02:45:18.726187901Z","time_started":"2026-10-29T02:44:35.189368Z"}}
3462026-10-29T02:45:18.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
3472026-10-29T02:45:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.311474ms iteration = 82 status = {"config_updated":false}
3482026-10-29T02:45:18.736ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
3492026-10-29T02:45:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.524879ms iteration = 28 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
3502026-10-29T02:45:19.187ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:1057 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:38687
3512026-10-29T02:45:19.187ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8e02f6c9-8b8f-4f97-9e93-763a45e9eea4 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
3522026-10-29T02:45:19.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8e02f6c9-8b8f-4f97-9e93-763a45e9eea4 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
3532026-10-29T02:45:19.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8e02f6c9-8b8f-4f97-9e93-763a45e9eea4 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
3542026-10-29T02:45:19.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8e02f6c9-8b8f-4f97-9e93-763a45e9eea4 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
3552026-10-29T02:45:19.191ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 72e7a89c-6323-4a56-88e6-2a328cd6572c uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
3562026-10-29T02:45:19.191ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 72e7a89c-6323-4a56-88e6-2a328cd6572c roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
3572026-10-29T02:45:19.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 72e7a89c-6323-4a56-88e6-2a328cd6572c resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
3582026-10-29T02:45:19.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 72e7a89c-6323-4a56-88e6-2a328cd6572c response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
3592026-10-29T02:45:20.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 153 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 5894b9c4-5d3d-49c5-9520-e50c3f1d20b3 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
3602026-10-29T02:45:23.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 83 reason = Timeout
3612026-10-29T02:45:23.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
3622026-10-29T02:45:23.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3632026-10-29T02:45:23.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3642026-10-29T02:45:23.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
3652026-10-29T02:45:23.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3662026-10-29T02:45:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3672026-10-29T02:45:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3682026-10-29T02:45:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3692026-10-29T02:45:23.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3702026-10-29T02:45:23.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3712026-10-29T02:45:23.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3722026-10-29T02:45:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3732026-10-29T02:45:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.702818ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3742026-10-29T02:45:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3752026-10-29T02:45:23.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3762026-10-29T02:45:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3772026-10-29T02:45:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
3782026-10-29T02:45:23.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3792026-10-29T02:45:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3802026-10-29T02:45:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3812026-10-29T02:45:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3822026-10-29T02:45:23.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
3832026-10-29T02:45:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.053819ms iteration = 83 status = {"config_updated":false}
3842026-10-29T02:45:23.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3852026-10-29T02:45:23.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
3862026-10-29T02:45:23.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3872026-10-29T02:45:23.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
3882026-10-29T02:45:23.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
3892026-10-29T02:45:23.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.206636ms iteration = 42 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
3902026-10-29T02:45:28.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 84 reason = Timeout
3912026-10-29T02:45:28.727ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3922026-10-29T02:45:28.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3932026-10-29T02:45:28.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942026-10-29T02:45:28.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
3952026-10-29T02:45:28.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
3962026-10-29T02:45:28.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
3972026-10-29T02:45:28.737ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
3982026-10-29T02:45:28.737ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.179441ms iteration = 84 status = {"config_updated":false}
3992026-10-29T02:45:30.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 135 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = f1ade766-166b-4089-bbd1-85c28280ff04 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
4002026-10-29T02:45:33.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 85 reason = Timeout
4012026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
4022026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 15 reason = Timeout
4032026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 8 reason = Timeout
4042026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
4052026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
4062026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 8 reason = Timeout
4072026-10-29T02:45:33.727ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
4082026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
4092026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
4102026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4112026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
4122026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 23 reason = Timeout
4132026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4142026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 15 reason = Timeout
4152026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
4162026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
4172026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 8 reason = Timeout
4182026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
4192026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
4202026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
4212026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4222026-10-29T02:45:33.727ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
4232026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
4242026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4252026-10-29T02:45:33.727ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = ExternalNetworking step id = Ensure
4262026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
4272026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
4282026-10-29T02:45:33.727ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4292026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4302026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
4312026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 29 reason = Timeout
4322026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4332026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
4342026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
4352026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4362026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
4372026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 31 reason = Timeout
4382026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
4392026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4402026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
4412026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
4422026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4432026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
4442026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
4452026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 8 reason = Timeout
4462026-10-29T02:45:33.727ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
4472026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
4482026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 15 reason = Timeout
4492026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
4502026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 22 reason = Timeout
4512026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
4522026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4532026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4542026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4552026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
4562026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4572026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4582026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
4592026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4602026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 21 reason = Timeout
4612026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 8 reason = Timeout
4622026-10-29T02:45:33.727ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
4632026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
4642026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 12.26\u{b5}s iteration = 21 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
4652026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4662026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
4672026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4682026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
4692026-10-29T02:45:33.727ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:35:33.727440151 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4702026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4712026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
4722026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
4732026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4742026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4752026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4762026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
4772026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 38 reason = Timeout
4782026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
4792026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
4802026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4812026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
4822026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4832026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4842026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4852026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
4862026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
4872026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
4882026-10-29T02:45:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4892026-10-29T02:45:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 405665410 } })
4902026-10-29T02:45:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 405666759 } })
4912026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4922026-10-29T02:45:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 405682290 } })
4932026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4942026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
4952026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
4962026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
4972026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
4982026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4992026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
5002026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
5012026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5022026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5032026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
5042026-10-29T02:45:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 405950455 } })
5052026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
5062026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
5072026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
5082026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
5092026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5102026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5112026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
5122026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
5132026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
5142026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5152026-10-29T02:45:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 406049318 } })
5162026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5172026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
5182026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5192026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
5202026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
5212026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
5222026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7a98a58c-60f8-441a-9caf-0654045c6e3e", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5232026-10-29T02:45:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5242026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5252026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5262026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5272026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
5282026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7955d16b-bb12-4b1e-812f-e57463b12b12", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5292026-10-29T02:45:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5302026-10-29T02:45:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
5312026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
5322026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 872.419\u{b5}s iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
5332026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
5342026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5352026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.369039ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5362026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "65823459-689c-47a8-9476-48bd8f48f3a2", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5372026-10-29T02:45:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5382026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b38bc2c7-e955-41b3-a84f-b6e212136213", "content-length": "50", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
5392026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5402026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5412026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.43994ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5422026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9b923ccf-9f81-4f2b-beaa-7ce33ccb2f5c", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5432026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52da409f-6e7b-4ffd-8745-5333525091f0", "content-length": "50", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
5442026-10-29T02:45:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5452026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
5462026-10-29T02:45:33.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
5472026-10-29T02:45:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.95482ms iteration = 15 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
5482026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
5492026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "64b50bea-2633-4e17-b147-a6c7280c1c83", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5502026-10-29T02:45:33.729ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5512026-10-29T02:45:33.729ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5522026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.535272ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
5532026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "09dc056c-acb8-4508-a6cd-75851a251871", "content-length": "681", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
5542026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
5552026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
5562026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
5572026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
5582026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
5592026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
5602026-10-29T02:45:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
5612026-10-29T02:45:33.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5622026-10-29T02:45:33.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632026-10-29T02:45:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5642026-10-29T02:45:33.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652026-10-29T02:45:33.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662026-10-29T02:45:33.730ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.602755ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
5682026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5702026-10-29T02:45:33.731ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5712026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5722026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5732026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5742026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
5752026-10-29T02:45:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
5762026-10-29T02:45:33.732ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 410078161 } })
5772026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
5782026-10-29T02:45:33.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
5792026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
5802026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5812026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 8 reason = Timeout
5822026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5832026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
5842026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
5852026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5862026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5872026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
5882026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5892026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
5902026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5912026-10-29T02:45:33.732ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
5922026-10-29T02:45:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 5.667048ms iteration = 15 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
5932026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
5952026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
5962026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982026-10-29T02:45:33.733ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:35:33.727440151 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5992026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.143167ms iteration = 8 status = {"expiration":"2026-10-29T02:35:33.727440151Z","pruned":[]}
6002026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.352372ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6012026-10-29T02:45:33.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022026-10-29T02:45:33.734ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
6032026-10-29T02:45:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
6042026-10-29T02:45:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.503026ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
6052026-10-29T02:45:33.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062026-10-29T02:45:33.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072026-10-29T02:45:33.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6082026-10-29T02:45:33.735ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
6092026-10-29T02:45:33.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6102026-10-29T02:45:33.736ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 8.610229ms iteration = 8 status = {"by_rx":{},"error":null}
6112026-10-29T02:45:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6122026-10-29T02:45:33.737ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
6132026-10-29T02:45:33.737ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 9.703372ms iteration = 22 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
6142026-10-29T02:45:33.737ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152026-10-29T02:45:33.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162026-10-29T02:45:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6172026-10-29T02:45:33.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6182026-10-29T02:45:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6192026-10-29T02:45:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6202026-10-29T02:45:33.742ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6212026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
6222026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
6232026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
6242026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
6252026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
6262026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
6272026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
6282026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
6292026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
6302026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
6312026-10-29T02:45:33.745ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
6322026-10-29T02:45:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6332026-10-29T02:45:33.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6342026-10-29T02:45:33.746ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 18.74279ms iteration = 8 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
6352026-10-29T02:45:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6362026-10-29T02:45:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6372026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
6382026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
6392026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
6402026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
6412026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
6422026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
6432026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6442026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6452026-10-29T02:45:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
6462026-10-29T02:45:33.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
6472026-10-29T02:45:33.749ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
6482026-10-29T02:45:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
6492026-10-29T02:45:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
6502026-10-29T02:45:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6512026-10-29T02:45:33.751ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6dd4d226-8a31-450a-9cfd-dff1b7e05b0a original_time_started = 2026-10-29 02:44:35.189368 UTC
6522026-10-29T02:45:33.751ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 23.716063ms iteration = 38 status = {"Loaded":{"collection_id":"6dd4d226-8a31-450a-9cfd-dff1b7e05b0a","time_loaded":"2026-10-29T02:45:33.727484362Z","time_started":"2026-10-29T02:44:35.189368Z"}}
6532026-10-29T02:45:33.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
6542026-10-29T02:45:33.751ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
6552026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
6562026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
6572026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
6582026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
6592026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
6602026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
6612026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6622026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
6632026-10-29T02:45:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6642026-10-29T02:45:33.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6652026-10-29T02:45:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
6662026-10-29T02:45:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6672026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
6682026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
6692026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
6702026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
6712026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6722026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6732026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
6742026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 27.199725ms iteration = 85 status = {"config_updated":false}
6752026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
6762026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea614735-d912-4e59-87ac-2f671b073be8", "content-length": "81", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
6772026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6782026-10-29T02:45:33.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6792026-10-29T02:45:33.763ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6802026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
6832026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
6842026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
6852026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6862026-10-29T02:45:33.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6872026-10-29T02:45:33.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
6882026-10-29T02:45:33.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
6892026-10-29T02:45:33.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
6902026-10-29T02:45:33.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6912026-10-29T02:45:33.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6922026-10-29T02:45:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6932026-10-29T02:45:33.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942026-10-29T02:45:33.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6952026-10-29T02:45:33.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6962026-10-29T02:45:33.789ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6972026-10-29T02:45:33.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.429937ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6982026-10-29T02:45:33.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6992026-10-29T02:45:33.793ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
7002026-10-29T02:45:33.793ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 66.38574ms iteration = 31 status = {"Loaded":{"time_loaded":"2026-10-29T02:45:33.727231147Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
7012026-10-29T02:45:33.822ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 89.848627ms iteration = 8 status = {"samples_queued":6}
7022026-10-29T02:45:33.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 135.906115ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
7032026-10-29T02:45:33.863ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
7042026-10-29T02:45:33.863ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 136.745152ms iteration = 29 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
7052026-10-29T02:45:33.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062026-10-29T02:45:33.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7072026-10-29T02:45:33.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082026-10-29T02:45:33.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
7092026-10-29T02:45:33.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7102026-10-29T02:45:33.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7112026-10-29T02:45:33.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
7122026-10-29T02:45:33.879ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7132026-10-29T02:45:33.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7142026-10-29T02:45:33.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7152026-10-29T02:45:33.885ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
7162026-10-29T02:45:33.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
7172026-10-29T02:45:33.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
7182026-10-29T02:45:33.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
7192026-10-29T02:45:33.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202026-10-29T02:45:33.904ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
7212026-10-29T02:45:33.904ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
7222026-10-29T02:45:33.904ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 176.962779ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
7232026-10-29T02:45:33.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7242026-10-29T02:45:33.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7252026-10-29T02:45:33.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7262026-10-29T02:45:33.908ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7272026-10-29T02:45:33.908ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7282026-10-29T02:45:33.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7292026-10-29T02:45:33.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
7302026-10-29T02:45:33.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
7312026-10-29T02:45:33.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
7322026-10-29T02:45:33.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
7332026-10-29T02:45:33.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7342026-10-29T02:45:33.913ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7352026-10-29T02:45:33.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
7362026-10-29T02:45:33.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7372026-10-29T02:45:33.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7382026-10-29T02:45:33.914ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7392026-10-29T02:45:33.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7402026-10-29T02:45:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7412026-10-29T02:45:33.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f4f7db-562a-4d61-a2a7-c0894e44a3f9", "content-length": "372", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
7422026-10-29T02:45:33.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7432026-10-29T02:45:33.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7442026-10-29T02:45:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7452026-10-29T02:45:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7462026-10-29T02:45:33.916ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472026-10-29T02:45:33.917ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482026-10-29T02:45:33.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
7492026-10-29T02:45:33.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7502026-10-29T02:45:33.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
7512026-10-29T02:45:33.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7522026-10-29T02:45:33.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532026-10-29T02:45:33.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
7542026-10-29T02:45:33.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552026-10-29T02:45:33.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
7562026-10-29T02:45:33.922ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
7572026-10-29T02:45:33.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
7582026-10-29T02:45:33.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
7592026-10-29T02:45:33.924ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
7602026-10-29T02:45:33.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7612026-10-29T02:45:33.925ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622026-10-29T02:45:33.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
7632026-10-29T02:45:33.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
7642026-10-29T02:45:33.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
7652026-10-29T02:45:33.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7662026-10-29T02:45:33.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7672026-10-29T02:45:33.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
7682026-10-29T02:45:33.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7692026-10-29T02:45:33.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7702026-10-29T02:45:33.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7712026-10-29T02:45:33.932ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7722026-10-29T02:45:33.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7732026-10-29T02:45:33.935ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7742026-10-29T02:45:33.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7752026-10-29T02:45:33.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 210.413453ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7762026-10-29T02:45:33.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7772026-10-29T02:45:33.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
7782026-10-29T02:45:33.952ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7792026-10-29T02:45:33.952ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7802026-10-29T02:45:33.952ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7812026-10-29T02:45:33.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7822026-10-29T02:45:33.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7832026-10-29T02:45:33.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 229.943859ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
7842026-10-29T02:45:33.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7852026-10-29T02:45:33.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
7862026-10-29T02:45:33.964ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
7872026-10-29T02:45:33.964ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
7882026-10-29T02:45:33.965ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fc2b2ca-4af2-44fa-8672-35d5b352307c", "content-length": "81", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
7892026-10-29T02:45:33.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
7902026-10-29T02:45:33.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "a4a587b3-72cb-473f-b4c2-564a844eaee5", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
7912026-10-29T02:45:33.972ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
7922026-10-29T02:45:33.972ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
7932026-10-29T02:45:33.972ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 245.170836ms iteration = 8 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
7942026-10-29T02:45:33.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
7952026-10-29T02:45:33.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
7962026-10-29T02:45:33.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7972026-10-29T02:45:33.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7982026-10-29T02:45:33.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
7992026-10-29T02:45:33.983ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
8002026-10-29T02:45:33.983ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
8012026-10-29T02:45:33.984ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5e04b90-4fa3-48fe-8304-75ee54414a89", "content-length": "81", "date": "Thu, 29 Oct 2026 02:45:33 GMT"} })
8022026-10-29T02:45:33.984ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
8032026-10-29T02:45:33.984ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 257.175716ms iteration = 15 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
8042026-10-29T02:45:33.984ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
8052026-10-29T02:45:33.984ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 257.693606ms iteration = 43 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
8062026-10-29T02:45:33.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8072026-10-29T02:45:33.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8082026-10-29T02:45:33.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8092026-10-29T02:45:33.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8102026-10-29T02:45:34.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
8112026-10-29T02:45:34.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
8122026-10-29T02:45:34.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
8132026-10-29T02:45:34.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8142026-10-29T02:45:34.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8152026-10-29T02:45:34.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8162026-10-29T02:45:34.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8172026-10-29T02:45:34.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
8182026-10-29T02:45:34.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8192026-10-29T02:45:34.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8202026-10-29T02:45:34.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
8212026-10-29T02:45:34.017ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
8222026-10-29T02:45:34.017ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
8232026-10-29T02:45:34.017ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
8242026-10-29T02:45:34.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8252026-10-29T02:45:34.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8262026-10-29T02:45:34.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272026-10-29T02:45:34.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8282026-10-29T02:45:34.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8292026-10-29T02:45:34.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
8302026-10-29T02:45:34.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8312026-10-29T02:45:34.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
8322026-10-29T02:45:34.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
8332026-10-29T02:45:34.036ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
8342026-10-29T02:45:34.037ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3577d16-588d-4de5-8b6d-f1b5879a564a", "content-length": "691", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
8352026-10-29T02:45:34.037ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
8362026-10-29T02:45:34.037ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
8372026-10-29T02:45:34.037ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
8382026-10-29T02:45:34.037ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 305.237114ms iteration = 15 status = {}
8392026-10-29T02:45:34.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8402026-10-29T02:45:34.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8412026-10-29T02:45:34.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8422026-10-29T02:45:34.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8432026-10-29T02:45:34.044ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
8442026-10-29T02:45:34.044ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
8452026-10-29T02:45:34.044ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 317.664253ms iteration = 8 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
8462026-10-29T02:45:34.058ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
8472026-10-29T02:45:34.058ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
8482026-10-29T02:45:34.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8492026-10-29T02:45:34.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8502026-10-29T02:45:34.060ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
8512026-10-29T02:45:34.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8522026-10-29T02:45:34.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8532026-10-29T02:45:34.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8542026-10-29T02:45:34.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8552026-10-29T02:45:34.074ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
8562026-10-29T02:45:34.081ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8572026-10-29T02:45:34.081ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8582026-10-29T02:45:34.081ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 353.978348ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8592026-10-29T02:45:34.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
8602026-10-29T02:45:34.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
8612026-10-29T02:45:34.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622026-10-29T02:45:34.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8632026-10-29T02:45:34.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8642026-10-29T02:45:34.093ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
8652026-10-29T02:45:34.095ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
8662026-10-29T02:45:34.095ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8672026-10-29T02:45:34.095ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
8682026-10-29T02:45:34.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 363.482035ms iteration = 8 status = {"generation":1}
8692026-10-29T02:45:34.099ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
8702026-10-29T02:45:34.104ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
8712026-10-29T02:45:34.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 380.164092ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8722026-10-29T02:45:34.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8732026-10-29T02:45:34.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8742026-10-29T02:45:34.110ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
8752026-10-29T02:45:34.110ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 382.754066ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8762026-10-29T02:45:34.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
8772026-10-29T02:45:34.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
8782026-10-29T02:45:34.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8792026-10-29T02:45:34.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802026-10-29T02:45:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8812026-10-29T02:45:34.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8822026-10-29T02:45:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8832026-10-29T02:45:34.119ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
8842026-10-29T02:45:34.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 394.242624ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8852026-10-29T02:45:34.122ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
8862026-10-29T02:45:34.123ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
8872026-10-29T02:45:34.123ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 395.700665ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8882026-10-29T02:45:34.124ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 397.305368ms iteration = 28 status = {"disks_added":0,"errors":[]}
8892026-10-29T02:45:34.125ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
8902026-10-29T02:45:34.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
8912026-10-29T02:45:34.130ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
8922026-10-29T02:45:34.130ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
8932026-10-29T02:45:34.130ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 397.986503ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
8942026-10-29T02:45:34.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
8952026-10-29T02:45:34.131ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8962026-10-29T02:45:34.131ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8972026-10-29T02:45:34.132ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6f77c25b-ba4d-485e-b41c-436553d42823", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
8982026-10-29T02:45:34.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8992026-10-29T02:45:34.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9002026-10-29T02:45:34.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
9012026-10-29T02:45:34.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022026-10-29T02:45:34.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
9032026-10-29T02:45:34.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9042026-10-29T02:45:34.136ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
9052026-10-29T02:45:34.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9062026-10-29T02:45:34.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9072026-10-29T02:45:34.137ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 815704902 } })
9082026-10-29T02:45:34.139ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
9092026-10-29T02:45:34.139ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 412.203758ms iteration = 8 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
9102026-10-29T02:45:34.140ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
9112026-10-29T02:45:34.140ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
9122026-10-29T02:45:34.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9132026-10-29T02:45:34.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9142026-10-29T02:45:34.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
9152026-10-29T02:45:34.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
9162026-10-29T02:45:34.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
9172026-10-29T02:45:34.143ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
9182026-10-29T02:45:34.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192026-10-29T02:45:34.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202026-10-29T02:45:34.146ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
9212026-10-29T02:45:34.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222026-10-29T02:45:34.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
9232026-10-29T02:45:34.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
9242026-10-29T02:45:34.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
9252026-10-29T02:45:34.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9262026-10-29T02:45:34.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
9272026-10-29T02:45:34.150ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9282026-10-29T02:45:34.150ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9292026-10-29T02:45:34.151ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6f856e05-3734-4dc1-9159-39768350a783", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
9302026-10-29T02:45:34.151ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 424.37ms iteration = 22 status = {}
9312026-10-29T02:45:34.151ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Dependency
9322026-10-29T02:45:34.151ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9332026-10-29T02:45:34.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9342026-10-29T02:45:34.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9352026-10-29T02:45:34.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362026-10-29T02:45:34.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9372026-10-29T02:45:34.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9382026-10-29T02:45:34.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9392026-10-29T02:45:34.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9402026-10-29T02:45:34.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
9412026-10-29T02:45:34.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
9422026-10-29T02:45:34.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
9432026-10-29T02:45:34.158ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
9442026-10-29T02:45:34.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9452026-10-29T02:45:34.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9462026-10-29T02:45:34.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9472026-10-29T02:45:34.163ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9482026-10-29T02:45:34.163ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
9492026-10-29T02:45:34.163ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
9502026-10-29T02:45:34.163ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
9512026-10-29T02:45:34.163ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
9522026-10-29T02:45:34.163ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 436.246657ms iteration = 8 status = {"generation":2}
9532026-10-29T02:45:34.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9542026-10-29T02:45:34.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9552026-10-29T02:45:34.166ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
9562026-10-29T02:45:34.167ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
9572026-10-29T02:45:34.167ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 440.081338ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
9582026-10-29T02:45:34.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9592026-10-29T02:45:34.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9602026-10-29T02:45:34.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
9612026-10-29T02:45:34.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9622026-10-29T02:45:34.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
9632026-10-29T02:45:34.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642026-10-29T02:45:34.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9652026-10-29T02:45:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9662026-10-29T02:45:34.175ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9672026-10-29T02:45:34.175ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9682026-10-29T02:45:34.176ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6847072-6f20-42c1-9e3c-a3f8b25a18e2", "content-length": "372", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
9692026-10-29T02:45:34.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9702026-10-29T02:45:34.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9712026-10-29T02:45:34.178ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
9722026-10-29T02:45:34.182ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
9732026-10-29T02:45:34.185ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
9742026-10-29T02:45:34.186ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = SledList step id = Fetch
9752026-10-29T02:45:34.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
9762026-10-29T02:45:34.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
9772026-10-29T02:45:34.188ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 404d041c-d753-4f78-bf21-fae1183cc7f1 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
9782026-10-29T02:45:34.188ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 404d041c-d753-4f78-bf21-fae1183cc7f1 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
9792026-10-29T02:45:34.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 404d041c-d753-4f78-bf21-fae1183cc7f1 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
9802026-10-29T02:45:34.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9812026-10-29T02:45:34.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 5771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 404d041c-d753-4f78-bf21-fae1183cc7f1 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
9822026-10-29T02:45:34.194ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8ff7c50c-6ec4-4ee4-a7b9-3eda2f9b9edb uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
9832026-10-29T02:45:34.194ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8ff7c50c-6ec4-4ee4-a7b9-3eda2f9b9edb roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
9842026-10-29T02:45:34.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
9852026-10-29T02:45:34.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
9862026-10-29T02:45:34.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8ff7c50c-6ec4-4ee4-a7b9-3eda2f9b9edb resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
9872026-10-29T02:45:34.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
9882026-10-29T02:45:34.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 8ff7c50c-6ec4-4ee4-a7b9-3eda2f9b9edb response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
9892026-10-29T02:45:34.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9902026-10-29T02:45:34.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 474.922021ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
9912026-10-29T02:45:34.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
9922026-10-29T02:45:34.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
9932026-10-29T02:45:34.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
9942026-10-29T02:45:34.206ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
9952026-10-29T02:45:34.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9962026-10-29T02:45:34.207ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "881d2451-bc9f-48cb-bc45-b44838696f92", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
9972026-10-29T02:45:34.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9982026-10-29T02:45:34.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9992026-10-29T02:45:34.208ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = DeployNexusRecords step id = Ensure
10002026-10-29T02:45:34.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10012026-10-29T02:45:34.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10022026-10-29T02:45:34.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10032026-10-29T02:45:34.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10042026-10-29T02:45:34.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10052026-10-29T02:45:34.213ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
10062026-10-29T02:45:34.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10072026-10-29T02:45:34.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10082026-10-29T02:45:34.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10092026-10-29T02:45:34.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10102026-10-29T02:45:34.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10112026-10-29T02:45:34.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10122026-10-29T02:45:34.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10132026-10-29T02:45:34.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10142026-10-29T02:45:34.220ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
10152026-10-29T02:45:34.220ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.098419ms iteration = 15 status = {"incomplete_bootstore_configs":[]}
10162026-10-29T02:45:34.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172026-10-29T02:45:34.226ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10182026-10-29T02:45:34.226ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10192026-10-29T02:45:34.226ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2cda332f-bee0-47db-b566-3a7190e634d1", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
10202026-10-29T02:45:34.226ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 75.039989ms iteration = 23 status = {}
10212026-10-29T02:45:34.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
10222026-10-29T02:45:34.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10232026-10-29T02:45:34.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10242026-10-29T02:45:34.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10252026-10-29T02:45:34.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
10262026-10-29T02:45:34.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10272026-10-29T02:45:34.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10282026-10-29T02:45:34.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10292026-10-29T02:45:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10302026-10-29T02:45:34.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10312026-10-29T02:45:34.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
10322026-10-29T02:45:34.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10332026-10-29T02:45:34.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10342026-10-29T02:45:34.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10352026-10-29T02:45:34.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10362026-10-29T02:45:34.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372026-10-29T02:45:34.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
10382026-10-29T02:45:34.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10392026-10-29T02:45:34.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10402026-10-29T02:45:34.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10412026-10-29T02:45:34.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10422026-10-29T02:45:34.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10432026-10-29T02:45:34.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10442026-10-29T02:45:34.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10452026-10-29T02:45:34.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
10462026-10-29T02:45:34.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10472026-10-29T02:45:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10482026-10-29T02:45:34.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10492026-10-29T02:45:34.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10502026-10-29T02:45:34.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10512026-10-29T02:45:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
10522026-10-29T02:45:34.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10532026-10-29T02:45:34.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10542026-10-29T02:45:34.306ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = SledAgent step id = Ensure
10552026-10-29T02:45:34.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10562026-10-29T02:45:34.307ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
10572026-10-29T02:45:34.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10582026-10-29T02:45:34.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10592026-10-29T02:45:34.310ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "5d4b7511-d0dc-4aab-b9f0-d912fa5ae6d9", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
10602026-10-29T02:45:34.310ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = FirewallRules step id = Ensure
10612026-10-29T02:45:34.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10622026-10-29T02:45:34.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10632026-10-29T02:45:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10642026-10-29T02:45:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10652026-10-29T02:45:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
10662026-10-29T02:45:34.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10672026-10-29T02:45:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10682026-10-29T02:45:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10692026-10-29T02:45:34.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10702026-10-29T02:45:34.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10712026-10-29T02:45:34.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10722026-10-29T02:45:34.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10732026-10-29T02:45:34.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10742026-10-29T02:45:34.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10752026-10-29T02:45:34.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10762026-10-29T02:45:34.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10772026-10-29T02:45:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
10782026-10-29T02:45:34.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10792026-10-29T02:45:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10802026-10-29T02:45:34.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10812026-10-29T02:45:34.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10822026-10-29T02:45:34.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10832026-10-29T02:45:34.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10842026-10-29T02:45:34.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10852026-10-29T02:45:34.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10862026-10-29T02:45:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10872026-10-29T02:45:34.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10882026-10-29T02:45:34.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10892026-10-29T02:45:34.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
10902026-10-29T02:45:34.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10912026-10-29T02:45:34.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10922026-10-29T02:45:34.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10932026-10-29T02:45:34.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10942026-10-29T02:45:34.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
10952026-10-29T02:45:34.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
10962026-10-29T02:45:34.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
10972026-10-29T02:45:34.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
10982026-10-29T02:45:34.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992026-10-29T02:45:34.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002026-10-29T02:45:34.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
11012026-10-29T02:45:34.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
11022026-10-29T02:45:34.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
11032026-10-29T02:45:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11042026-10-29T02:45:34.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11052026-10-29T02:45:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11062026-10-29T02:45:34.350ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
11072026-10-29T02:45:34.350ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
11082026-10-29T02:45:34.350ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 94e6ef65-7a63-4498-a77d-b181e7fad85a parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
11092026-10-29T02:45:34.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
11102026-10-29T02:45:34.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
11112026-10-29T02:45:34.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122026-10-29T02:45:34.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11132026-10-29T02:45:34.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11142026-10-29T02:45:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
11152026-10-29T02:45:34.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
11162026-10-29T02:45:34.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11172026-10-29T02:45:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
11182026-10-29T02:45:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11192026-10-29T02:45:34.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11202026-10-29T02:45:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11212026-10-29T02:45:34.359ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
11222026-10-29T02:45:34.359ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
11232026-10-29T02:45:34.359ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 632.752812ms iteration = 23 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
11242026-10-29T02:45:34.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11252026-10-29T02:45:34.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11262026-10-29T02:45:34.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11272026-10-29T02:45:34.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11282026-10-29T02:45:34.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11292026-10-29T02:45:34.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11302026-10-29T02:45:34.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312026-10-29T02:45:34.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11322026-10-29T02:45:34.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11332026-10-29T02:45:34.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11342026-10-29T02:45:34.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352026-10-29T02:45:34.376ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
11362026-10-29T02:45:34.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11372026-10-29T02:45:34.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11382026-10-29T02:45:34.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11392026-10-29T02:45:34.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11402026-10-29T02:45:34.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11412026-10-29T02:45:34.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11422026-10-29T02:45:34.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11432026-10-29T02:45:34.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11442026-10-29T02:45:34.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11452026-10-29T02:45:34.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11462026-10-29T02:45:34.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11472026-10-29T02:45:34.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11482026-10-29T02:45:34.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11492026-10-29T02:45:34.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11502026-10-29T02:45:34.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11512026-10-29T02:45:34.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11522026-10-29T02:45:34.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11532026-10-29T02:45:34.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11542026-10-29T02:45:34.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11552026-10-29T02:45:34.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11562026-10-29T02:45:34.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11572026-10-29T02:45:34.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11582026-10-29T02:45:34.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11592026-10-29T02:45:34.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11602026-10-29T02:45:34.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612026-10-29T02:45:34.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11622026-10-29T02:45:34.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11632026-10-29T02:45:34.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11642026-10-29T02:45:34.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11652026-10-29T02:45:34.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11662026-10-29T02:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11672026-10-29T02:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11682026-10-29T02:45:34.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11692026-10-29T02:45:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11702026-10-29T02:45:34.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11712026-10-29T02:45:34.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11722026-10-29T02:45:34.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11732026-10-29T02:45:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11742026-10-29T02:45:34.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11752026-10-29T02:45:34.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11762026-10-29T02:45:34.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11772026-10-29T02:45:34.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11782026-10-29T02:45:34.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792026-10-29T02:45:34.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11802026-10-29T02:45:34.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11812026-10-29T02:45:34.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11822026-10-29T02:45:34.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11832026-10-29T02:45:34.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11842026-10-29T02:45:34.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11852026-10-29T02:45:34.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11862026-10-29T02:45:34.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872026-10-29T02:45:34.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11882026-10-29T02:45:34.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11892026-10-29T02:45:34.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11902026-10-29T02:45:34.463ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
11912026-10-29T02:45:34.463ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
11922026-10-29T02:45:34.463ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
11932026-10-29T02:45:34.541ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
11942026-10-29T02:45:34.541ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
11952026-10-29T02:45:34.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11962026-10-29T02:45:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11972026-10-29T02:45:34.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
11982026-10-29T02:45:34.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
11992026-10-29T02:45:34.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002026-10-29T02:45:34.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
12012026-10-29T02:45:34.549ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12022026-10-29T02:45:34.550ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ef1fa9ab-fe64-4078-919c-b0772d01c88b", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
12032026-10-29T02:45:34.550ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
12042026-10-29T02:45:34.550ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = Dns step id = Ensure
12052026-10-29T02:45:34.550ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
12062026-10-29T02:45:34.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12072026-10-29T02:45:34.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12082026-10-29T02:45:34.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12092026-10-29T02:45:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12102026-10-29T02:45:34.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112026-10-29T02:45:34.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12122026-10-29T02:45:34.558ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
12132026-10-29T02:45:34.558ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
12142026-10-29T02:45:34.558ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
12152026-10-29T02:45:34.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12162026-10-29T02:45:34.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12172026-10-29T02:45:34.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182026-10-29T02:45:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12192026-10-29T02:45:34.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12202026-10-29T02:45:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12212026-10-29T02:45:34.566ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
12222026-10-29T02:45:34.566ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12232026-10-29T02:45:34.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12242026-10-29T02:45:34.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12252026-10-29T02:45:34.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262026-10-29T02:45:34.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12272026-10-29T02:45:34.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12282026-10-29T02:45:34.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12292026-10-29T02:45:34.575ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
12302026-10-29T02:45:34.575ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
12312026-10-29T02:45:34.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
12322026-10-29T02:45:34.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12332026-10-29T02:45:34.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12342026-10-29T02:45:34.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12352026-10-29T02:45:34.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12362026-10-29T02:45:34.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12372026-10-29T02:45:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12382026-10-29T02:45:34.583ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
12392026-10-29T02:45:34.583ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
12402026-10-29T02:45:34.583ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
12412026-10-29T02:45:34.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12422026-10-29T02:45:34.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12432026-10-29T02:45:34.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12442026-10-29T02:45:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12452026-10-29T02:45:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12462026-10-29T02:45:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12472026-10-29T02:45:34.591ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
12482026-10-29T02:45:34.591ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
12492026-10-29T02:45:34.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12502026-10-29T02:45:34.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12512026-10-29T02:45:34.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12522026-10-29T02:45:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12532026-10-29T02:45:34.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12542026-10-29T02:45:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12552026-10-29T02:45:34.598ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
12562026-10-29T02:45:34.598ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
12572026-10-29T02:45:34.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12582026-10-29T02:45:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12592026-10-29T02:45:34.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602026-10-29T02:45:34.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
12612026-10-29T02:45:34.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12622026-10-29T02:45:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12632026-10-29T02:45:34.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12642026-10-29T02:45:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12652026-10-29T02:45:34.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12662026-10-29T02:45:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12672026-10-29T02:45:34.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12682026-10-29T02:45:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
12692026-10-29T02:45:34.613ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
12702026-10-29T02:45:34.614ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
12712026-10-29T02:45:34.614ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = OmicronZones step id = Cleanup
12722026-10-29T02:45:34.614ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = OmicronZones step id = Cleanup
12732026-10-29T02:45:34.614ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = PhysicalDisks step id = Cleanup
12742026-10-29T02:45:34.614ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = Clickhouse step id = Ensure
12752026-10-29T02:45:34.614ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = Clickhouse step id = Ensure
12762026-10-29T02:45:34.614ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
12772026-10-29T02:45:34.614ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 503, headers: {"content-type": "application/json", "x-request-id": "0ffabff9-9a88-4f00-8770-756208e58a92", "content-length": "94", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
12782026-10-29T02:45:34.614ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = SupportBundles step id = Cleanup
12792026-10-29T02:45:34.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12802026-10-29T02:45:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12812026-10-29T02:45:34.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822026-10-29T02:45:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
12832026-10-29T02:45:34.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12842026-10-29T02:45:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12852026-10-29T02:45:34.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12862026-10-29T02:45:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12872026-10-29T02:45:34.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882026-10-29T02:45:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
12892026-10-29T02:45:34.686ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = OmicronZones step id = Cleanup
12902026-10-29T02:45:34.686ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
12912026-10-29T02:45:34.686ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
12922026-10-29T02:45:34.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12932026-10-29T02:45:34.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12942026-10-29T02:45:34.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12952026-10-29T02:45:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
12962026-10-29T02:45:34.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
12972026-10-29T02:45:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
12982026-10-29T02:45:34.691ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
12992026-10-29T02:45:34.691ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
13002026-10-29T02:45:34.691ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = OmicronZones step id = Cleanup
13012026-10-29T02:45:34.691ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
13022026-10-29T02:45:34.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
13032026-10-29T02:45:34.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
13042026-10-29T02:45:34.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052026-10-29T02:45:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
13062026-10-29T02:45:34.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
13072026-10-29T02:45:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
13082026-10-29T02:45:34.750ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
13092026-10-29T02:45:34.750ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = Cockroach step id = Ensure
13102026-10-29T02:45:34.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
13112026-10-29T02:45:34.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
13122026-10-29T02:45:34.757ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
13132026-10-29T02:45:34.757ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c step component = MgsUpdates step id = Ensure
13142026-10-29T02:45:34.757ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Dependency
13152026-10-29T02:45:34.757ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 9 reason = Dependency
13162026-10-29T02:45:34.757ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13172026-10-29T02:45:34.757ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13182026-10-29T02:45:34.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13192026-10-29T02:45:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13202026-10-29T02:45:34.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.030858177s iteration = 9 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":2360,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":459035822,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":459035772,"secs":0}},"event_index":1,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":459047042,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":22496688,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":22496638,"secs":0}},"event_index":2,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":481561690,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":98182581,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":98182541,"secs":0}},"event_index":3,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":579760411,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3455652,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3455602,"secs":0}},"event_index":4,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":583240973,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":239949088,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":239949048,"secs":0}},"event_index":5,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":823200431,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":63682133,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":63682103,"secs":0}},"event_index":6,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":886890264,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4951,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":4921,"secs":0}},"event_index":7,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":886908165,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2330,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2290,"secs":0}},"event_index":8,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":886912615,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2660,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":2620,"secs":0}},"event_index":9,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":886917005,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":1740,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":1700,"secs":0}},"event_index":10,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":886920295,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":506651,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"warning","message":"failed to initialize single-node clickhouse database: Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"0ffabff9-9a88-4f00-8770-756208e58a92\\", \\"content-length\\": \\"94\\", \\"date\\": \\"Thu, 29 Oct 2026 02:45:34 GMT\\"}; value: Error { error_code: None, message: \\"Service Unavailable\\", request_id: \\"0ffabff9-9a88-4f00-8770-756208e58a92\\" }","metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":506620,"secs":0}},"event_index":11,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":887427826,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":71537827,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":71537776,"secs":0}},"event_index":12,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":958974933,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":5638237,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":5638197,"secs":0}},"event_index":13,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":964630640,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":58639829,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":58639789,"secs":0}},"event_index":14,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":23286429,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":7040476,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":7040436,"secs":0}},"event_index":15,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":30339276,"secs":1}},{"data":{"attempt_elapsed":{"nanos":5440,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":5400,"secs":0}},"event_index":16,"execution_id":"83b9e8bf-7e0a-42a7-91a9-69d41c4cb12c","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":30354216,"secs":1}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
13212026-10-29T02:45:34.759ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222026-10-29T02:45:34.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232026-10-29T02:45:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13242026-10-29T02:45:34.763ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13252026-10-29T02:45:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13262026-10-29T02:45:34.763ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13272026-10-29T02:45:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13282026-10-29T02:45:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13292026-10-29T02:45:34.765ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13302026-10-29T02:45:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13312026-10-29T02:45:34.767ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322026-10-29T02:45:34.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13332026-10-29T02:45:34.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13342026-10-29T02:45:34.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13352026-10-29T02:45:34.772ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
13362026-10-29T02:45:34.772ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 14.995202ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
13372026-10-29T02:45:34.792ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(e3cb9a7b-cd38-4a57-a0d5-9eab025bc926, 0), (4f6c062a-4439-4954-b4c4-4a3a5d89c70a, 0), (6dd4d226-8a31-450a-9cfd-dff1b7e05b0a, 0)]
13382026-10-29T02:45:34.793ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1096, tv_nsec: 471316289 } })
13392026-10-29T02:45:34.794ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1096, tv_nsec: 472494953 } })
13402026-10-29T02:45:34.795ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
13412026-10-29T02:45:34.795ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
13422026-10-29T02:45:34.795ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
13432026-10-29T02:45:34.795ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0729d519-8fa1-40db-b5a2-4c37d39c06c0", "content-length": "50", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13442026-10-29T02:45:34.795ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
13452026-10-29T02:45:34.796ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "51332af5-61d3-49f6-97c4-31f34ee893cd", "content-length": "681", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13462026-10-29T02:45:34.796ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
13472026-10-29T02:45:34.796ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "76855928-3f0e-4ff6-a3de-26f6ebbffbb7", "content-length": "734", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13482026-10-29T02:45:34.796ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
13492026-10-29T02:45:34.797ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e10eeac1-639f-4ae5-a843-735d724ff96a", "content-length": "111", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13502026-10-29T02:45:34.797ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
13512026-10-29T02:45:34.798ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ebe45d-6655-4bb8-96e7-8f461ab02956", "content-length": "111", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13522026-10-29T02:45:34.798ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
13532026-10-29T02:45:34.799ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "429a7a67-9334-4a95-a6e4-ddf807d4d0e7", "content-length": "163", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13542026-10-29T02:45:34.799ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
13552026-10-29T02:45:34.800ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8c427a4-74de-4634-b152-70cc4c045cc8", "content-length": "163", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13562026-10-29T02:45:34.800ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
13572026-10-29T02:45:34.801ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c45abd2b-3c81-4bec-ab87-4932b54f0c89", "content-length": "166", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13582026-10-29T02:45:34.801ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
13592026-10-29T02:45:34.802ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "86c7f375-3c8b-472c-b562-dcab11421acc", "content-length": "166", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13602026-10-29T02:45:34.802ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
13612026-10-29T02:45:34.802ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2181f2-478e-4eaa-9fb2-c3f96871d35a", "content-length": "702", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13622026-10-29T02:45:34.802ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13632026-10-29T02:45:34.803ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4757724c-a1f7-4b7c-bfb1-99c8b6481128", "content-length": "727", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13642026-10-29T02:45:34.803ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13652026-10-29T02:45:34.803ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e728b1a-3fce-49c0-9226-1ce6c4dedd4f", "content-length": "729", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13662026-10-29T02:45:34.803ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13672026-10-29T02:45:34.803ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "777bd0e3-f260-4d7a-981e-39fe91e40604", "content-length": "728", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13682026-10-29T02:45:34.803ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
13692026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba6096a-daca-4da3-8b6d-5099161fa0c9", "content-length": "722", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13702026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
13712026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "26280e2f-17b1-4098-8a89-7babf54ad015", "content-length": "10", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13722026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
13732026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc3b5e53-e6b0-4ff2-bdc9-b2f9435ff21e", "content-length": "144", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13742026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
13752026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcdc494e-0f94-44f2-bedd-a1b79782563e", "content-length": "147", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13762026-10-29T02:45:34.804ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
13772026-10-29T02:45:34.805ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "024c94b7-e9ed-4686-aef7-93abcd0ce806", "content-length": "109", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13782026-10-29T02:45:34.805ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
13792026-10-29T02:45:34.806ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6eb7430-4545-4005-9da3-616db6474e7a", "content-length": "109", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13802026-10-29T02:45:34.806ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
13812026-10-29T02:45:34.806ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95ff1fcc-4361-4310-ba34-ccd71068a607", "content-length": "163", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13822026-10-29T02:45:34.806ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
13832026-10-29T02:45:34.807ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b2780fe-b4d8-4b96-a582-12c636d878fb", "content-length": "163", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13842026-10-29T02:45:34.807ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
13852026-10-29T02:45:34.808ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6e6fac2-f6d9-4ea5-ad40-a027b3d8def2", "content-length": "166", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13862026-10-29T02:45:34.808ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
13872026-10-29T02:45:34.808ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c37ceb6-50db-4b87-bef3-16c1c1fa67f9", "content-length": "166", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13882026-10-29T02:45:34.808ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
13892026-10-29T02:45:34.808ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ec4f55a-2dd5-40ae-8e55-ce0f00c1503b", "content-length": "702", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13902026-10-29T02:45:34.808ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13912026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4420bfa-4195-4ba6-aad0-61c5f772e460", "content-length": "727", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13922026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13932026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "072f8e67-46b4-4ae0-90b7-04d882ea3c55", "content-length": "729", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13942026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13952026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "036ccfee-63a5-4143-9a56-aefbe4a9ca8c", "content-length": "728", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13962026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
13972026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "194b6a1c-7eb4-47d3-aa6f-638841ee00b8", "content-length": "722", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
13982026-10-29T02:45:34.809ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
13992026-10-29T02:45:34.810ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "6633feac-2259-4ee8-85f1-316a57110e9b", "content-length": "10", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14002026-10-29T02:45:34.810ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
14012026-10-29T02:45:34.810ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30918081-d674-4e57-a94a-d7e3c474a836", "content-length": "144", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14022026-10-29T02:45:34.810ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
14032026-10-29T02:45:34.810ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcbd6523-a2fd-4630-8b82-cdc68a2b516d", "content-length": "147", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14042026-10-29T02:45:34.810ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
14052026-10-29T02:45:34.811ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4702495-80a8-4f0f-9ead-5bd321646c1d", "content-length": "109", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14062026-10-29T02:45:34.811ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
14072026-10-29T02:45:34.812ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f44c667-7ed1-404e-859d-cd2defc80305", "content-length": "109", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14082026-10-29T02:45:34.812ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
14092026-10-29T02:45:34.812ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "66d11a4e-df44-46cc-9c41-d02c9c1caef4", "content-length": "163", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14102026-10-29T02:45:34.812ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
14112026-10-29T02:45:34.813ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "980fca12-c164-4fa5-a2a9-a39c0742069c", "content-length": "163", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14122026-10-29T02:45:34.813ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
14132026-10-29T02:45:34.813ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60d93168-0da6-4c72-a75e-039e0f86af32", "content-length": "166", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14142026-10-29T02:45:34.813ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
14152026-10-29T02:45:34.814ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf507d0f-3684-4e32-bcbe-be63e8ee69a0", "content-length": "166", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14162026-10-29T02:45:34.814ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
14172026-10-29T02:45:34.814ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3669fecb-c53d-4ec4-975e-bd6153943ce4", "content-length": "702", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14182026-10-29T02:45:34.814ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
14192026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "807849c9-14e3-42da-9d84-654e7573c7b4", "content-length": "727", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14202026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
14212026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a27d74a-77e4-48bf-a5fe-41cba389c56d", "content-length": "729", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14222026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
14232026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d8d953f-d4db-401a-a562-13abd5660f7f", "content-length": "728", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14242026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14252026-10-29T02:45:34.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
14262026-10-29T02:45:34.817ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14272026-10-29T02:45:34.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14282026-10-29T02:45:34.820ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14292026-10-29T02:45:34.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
14302026-10-29T02:45:34.822ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14312026-10-29T02:45:34.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14322026-10-29T02:45:34.824ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14332026-10-29T02:45:34.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
14342026-10-29T02:45:34.827ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
14352026-10-29T02:45:34.827ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
14362026-10-29T02:45:34.889ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceb09ac1-7ed0-4409-9337-fb0ef35c6595", "content-length": "93656", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14372026-10-29T02:45:34.889ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
14382026-10-29T02:45:34.889ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
14392026-10-29T02:45:34.890ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
14402026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
14412026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
14422026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
14432026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
14442026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
14452026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "caef027a-b0cf-4cb1-a8dc-afc9b5b80ed8", "content-length": "64", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14462026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d1533cd-8692-4009-984f-2781cb18193a", "content-length": "64", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14472026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a54ac16d-7c5e-478f-a210-ccd8a4b3f6a9", "content-length": "64", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14482026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
14492026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
14502026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
14512026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2220d490-c15e-4772-ad3f-0363939b8c98", "content-length": "64", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14522026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
14532026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25819379-b484-429a-826c-bb76a01da89b", "content-length": "64", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14542026-10-29T02:45:34.890ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
14552026-10-29T02:45:34.897ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94e124a-04b8-460f-aaf8-2dcc55b80277", "content-length": "410652", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14562026-10-29T02:45:34.897ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ffe2faf-2b2b-4ece-9b85-6174175bec2c", "content-length": "409434", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14572026-10-29T02:45:34.898ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "57c90508-6f4e-4a54-9195-66af8a53a893", "content-length": "412095", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14582026-10-29T02:45:34.899ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "75f63e7b-d3ef-4a5b-a61b-9e08ac13745a", "content-length": "422319", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14592026-10-29T02:45:34.900ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "e068c428-dbd0-484b-a997-238d08d41dd1", "content-length": "409782", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14602026-10-29T02:45:34.902ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
14612026-10-29T02:45:34.902ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
14622026-10-29T02:45:34.902ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
14632026-10-29T02:45:34.902ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
14642026-10-29T02:45:34.902ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
14652026-10-29T02:45:34.903ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
14662026-10-29T02:45:34.903ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
14672026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "913b46a8-8bf1-4f41-8019-2a1d8318d4a3", "content-length": "260", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14682026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
14692026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
14702026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
14712026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
14722026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
14732026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
14742026-10-29T02:45:34.906ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
14752026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5fccbc1-4313-406b-9002-fb1cfef16f67", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14762026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d1512da-7cc0-4aaf-a6a6-2d7bcf2be002", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14772026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f358373c-dc57-4f1a-80c8-05745a280213", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:45:34 GMT"} })
14782026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
14792026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
14802026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
14812026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
14822026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
14832026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14842026-10-29T02:45:34.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
14852026-10-29T02:45:34.910ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862026-10-29T02:45:34.912ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14872026-10-29T02:45:34.912ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14882026-10-29T02:45:34.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
14892026-10-29T02:45:35.155ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = dd5206a3-4950-4298-b192-e23e6c5b5181 file = nexus/db-queries/src/db/datastore/inventory.rs:2241
14902026-10-29T02:45:35.156ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = dd5206a3-4950-4298-b192-e23e6c5b5181 time_started = 2026-10-29 02:45:34.795281 UTC
14912026-10-29T02:45:35.156ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 39 reason = Dependency
14922026-10-29T02:45:35.156ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
14932026-10-29T02:45:35.156ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 398.481902ms iteration = 9 status = {"collection_id":"dd5206a3-4950-4298-b192-e23e6c5b5181","time_done":"2026-10-29 02:45:34.907512 UTC","time_started":"2026-10-29 02:45:34.795281 UTC"}
14942026-10-29T02:45:35.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
14952026-10-29T02:45:35.157ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962026-10-29T02:45:35.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
14972026-10-29T02:45:35.161ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
14982026-10-29T02:45:35.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
14992026-10-29T02:45:35.163ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
15002026-10-29T02:45:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
15012026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 77.496841ms iteration = 39 status = {"Loaded":{"collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","time_loaded":"2026-10-29T02:45:35.156034975Z","time_started":"2026-10-29T02:45:34.796122Z"}}
15022026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 22 reason = Dependency
15032026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 17 reason = Dependency
15042026-10-29T02:45:35.233ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
15052026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 24 reason = Dependency
15062026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Dependency
15072026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 24.671\u{b5}s iteration = 22 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
15082026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15092026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 22 reason = Dependency
15102026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
15112026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15122026-10-29T02:45:35.233ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
15132026-10-29T02:45:35.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
15142026-10-29T02:45:35.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15152026-10-29T02:45:35.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
15162026-10-29T02:45:35.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15172026-10-29T02:45:35.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182026-10-29T02:45:35.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15192026-10-29T02:45:35.236ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202026-10-29T02:45:35.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15212026-10-29T02:45:35.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15222026-10-29T02:45:35.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15232026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15242026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15252026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15262026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
15272026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
15282026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
15292026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
15302026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15312026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
15322026-10-29T02:45:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
15332026-10-29T02:45:35.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15342026-10-29T02:45:35.242ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15352026-10-29T02:45:35.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15362026-10-29T02:45:35.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15372026-10-29T02:45:35.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15382026-10-29T02:45:35.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15392026-10-29T02:45:35.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
15402026-10-29T02:45:35.245ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
15412026-10-29T02:45:35.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
15422026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15432026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15442026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
15452026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
15462026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15472026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15482026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
15492026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15502026-10-29T02:45:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15512026-10-29T02:45:35.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15522026-10-29T02:45:35.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
15532026-10-29T02:45:35.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15542026-10-29T02:45:35.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
15552026-10-29T02:45:35.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15562026-10-29T02:45:35.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572026-10-29T02:45:35.253ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15582026-10-29T02:45:35.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15592026-10-29T02:45:35.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15602026-10-29T02:45:35.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15612026-10-29T02:45:35.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15622026-10-29T02:45:35.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
15632026-10-29T02:45:35.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
15642026-10-29T02:45:35.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
15652026-10-29T02:45:35.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15662026-10-29T02:45:35.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15672026-10-29T02:45:35.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682026-10-29T02:45:35.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15692026-10-29T02:45:35.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702026-10-29T02:45:35.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15712026-10-29T02:45:35.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15722026-10-29T02:45:35.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15732026-10-29T02:45:35.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
15742026-10-29T02:45:35.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
15752026-10-29T02:45:35.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
15762026-10-29T02:45:35.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15772026-10-29T02:45:35.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15782026-10-29T02:45:35.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15792026-10-29T02:45:35.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802026-10-29T02:45:35.264ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.188738ms iteration = 29 status = {"disks_added":0,"errors":[]}
15812026-10-29T02:45:35.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15822026-10-29T02:45:35.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15832026-10-29T02:45:35.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15842026-10-29T02:45:35.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15852026-10-29T02:45:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15862026-10-29T02:45:35.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872026-10-29T02:45:35.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15882026-10-29T02:45:35.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15892026-10-29T02:45:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15902026-10-29T02:45:35.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15912026-10-29T02:45:35.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15922026-10-29T02:45:35.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15932026-10-29T02:45:35.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15942026-10-29T02:45:35.278ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
15952026-10-29T02:45:35.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15962026-10-29T02:45:35.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15972026-10-29T02:45:35.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982026-10-29T02:45:35.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15992026-10-29T02:45:35.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
16002026-10-29T02:45:35.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
16012026-10-29T02:45:35.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16022026-10-29T02:45:35.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
16032026-10-29T02:45:35.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
16042026-10-29T02:45:35.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
16052026-10-29T02:45:35.289ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
16062026-10-29T02:45:35.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
16072026-10-29T02:45:35.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
16082026-10-29T02:45:35.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092026-10-29T02:45:35.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
16102026-10-29T02:45:35.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
16112026-10-29T02:45:35.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
16122026-10-29T02:45:35.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132026-10-29T02:45:35.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
16142026-10-29T02:45:35.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
16152026-10-29T02:45:35.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
16162026-10-29T02:45:35.301ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
16172026-10-29T02:45:35.301ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 15 reason = Dependency
16182026-10-29T02:45:35.301ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
16192026-10-29T02:45:35.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 67.8191ms iteration = 17 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
16202026-10-29T02:45:35.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
16212026-10-29T02:45:35.302ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16222026-10-29T02:45:35.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16232026-10-29T02:45:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16242026-10-29T02:45:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16252026-10-29T02:45:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16262026-10-29T02:45:35.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
16272026-10-29T02:45:35.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16282026-10-29T02:45:35.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16292026-10-29T02:45:35.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16302026-10-29T02:45:35.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16312026-10-29T02:45:35.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16322026-10-29T02:45:35.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
16332026-10-29T02:45:35.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16342026-10-29T02:45:35.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16352026-10-29T02:45:35.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16362026-10-29T02:45:35.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16372026-10-29T02:45:35.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16382026-10-29T02:45:35.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
16392026-10-29T02:45:35.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16402026-10-29T02:45:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16412026-10-29T02:45:35.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16422026-10-29T02:45:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16432026-10-29T02:45:35.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442026-10-29T02:45:35.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
16452026-10-29T02:45:35.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16462026-10-29T02:45:35.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16472026-10-29T02:45:35.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16482026-10-29T02:45:35.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16492026-10-29T02:45:35.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502026-10-29T02:45:35.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
16512026-10-29T02:45:35.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16522026-10-29T02:45:35.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16532026-10-29T02:45:35.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16542026-10-29T02:45:35.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16552026-10-29T02:45:35.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562026-10-29T02:45:35.359ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16572026-10-29T02:45:35.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16582026-10-29T02:45:35.360ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16592026-10-29T02:45:35.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16602026-10-29T02:45:35.361ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612026-10-29T02:45:35.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
16622026-10-29T02:45:35.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16632026-10-29T02:45:35.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16642026-10-29T02:45:35.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
16652026-10-29T02:45:35.364ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16662026-10-29T02:45:35.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16672026-10-29T02:45:35.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16682026-10-29T02:45:35.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16692026-10-29T02:45:35.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16702026-10-29T02:45:35.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16712026-10-29T02:45:35.368ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16722026-10-29T02:45:35.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
16732026-10-29T02:45:35.410ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
16742026-10-29T02:45:35.410ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 109.479365ms iteration = 15 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
16752026-10-29T02:45:35.410ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 23 reason = Dependency
16762026-10-29T02:45:35.410ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
16772026-10-29T02:45:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
16782026-10-29T02:45:35.421ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16792026-10-29T02:45:35.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16802026-10-29T02:45:35.422ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16812026-10-29T02:45:35.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
16822026-10-29T02:45:35.425ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16832026-10-29T02:45:35.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16842026-10-29T02:45:35.427ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16852026-10-29T02:45:35.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16862026-10-29T02:45:35.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16872026-10-29T02:45:35.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16882026-10-29T02:45:35.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16892026-10-29T02:45:35.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16902026-10-29T02:45:35.429ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912026-10-29T02:45:35.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16922026-10-29T02:45:35.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
16932026-10-29T02:45:35.432ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
16942026-10-29T02:45:35.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
16952026-10-29T02:45:35.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
16962026-10-29T02:45:35.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16972026-10-29T02:45:35.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
16982026-10-29T02:45:35.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
16992026-10-29T02:45:35.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17002026-10-29T02:45:35.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012026-10-29T02:45:35.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
17022026-10-29T02:45:35.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17032026-10-29T02:45:35.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17042026-10-29T02:45:35.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17052026-10-29T02:45:35.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17062026-10-29T02:45:35.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072026-10-29T02:45:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
17082026-10-29T02:45:35.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17092026-10-29T02:45:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17102026-10-29T02:45:35.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17112026-10-29T02:45:35.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17122026-10-29T02:45:35.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132026-10-29T02:45:35.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
17142026-10-29T02:45:35.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17152026-10-29T02:45:35.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17162026-10-29T02:45:35.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17172026-10-29T02:45:35.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17182026-10-29T02:45:35.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17192026-10-29T02:45:35.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
17202026-10-29T02:45:35.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17212026-10-29T02:45:35.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17222026-10-29T02:45:35.467ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
17232026-10-29T02:45:35.467ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 56.428293ms iteration = 23 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
17242026-10-29T02:45:35.487ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
17252026-10-29T02:45:35.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
17262026-10-29T02:45:35.489ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17272026-10-29T02:45:35.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
17282026-10-29T02:45:35.491ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
17292026-10-29T02:45:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
17302026-10-29T02:45:35.494ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
17312026-10-29T02:45:35.494ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
17322026-10-29T02:45:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
17332026-10-29T02:45:35.496ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17342026-10-29T02:45:35.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
17352026-10-29T02:45:35.499ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
17362026-10-29T02:45:35.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
17372026-10-29T02:45:35.501ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
17382026-10-29T02:45:35.502ZINFOnexus (BackgroundTasks): building sitrep 3802202d-58d7-4f6b-945f-eb9e557d83dd (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 3802202d-58d7-4f6b-945f-eb9e557d83dd (sitrep)
17392026-10-29T02:45:35.502ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
17402026-10-29T02:45:35.502ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 268.4857ms iteration = 22 status = {"inv_collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:45:35.502007525Z","outcome":"Unchanged","start_time":"2026-10-29T02:45:35.501981705Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
17412026-10-29T02:45:35.513ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
17422026-10-29T02:45:35.513ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
17432026-10-29T02:45:35.513ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 004f8812-1f28-42a5-8ebb-11eaefe2b41f parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
17442026-10-29T02:45:35.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17452026-10-29T02:45:35.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17462026-10-29T02:45:35.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472026-10-29T02:45:35.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
17482026-10-29T02:45:35.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
17492026-10-29T02:45:35.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
17502026-10-29T02:45:35.524ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
17512026-10-29T02:45:35.524ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
17522026-10-29T02:45:35.524ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 290.752373ms iteration = 24 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
17532026-10-29T02:45:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 86 reason = Timeout
17542026-10-29T02:45:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
17552026-10-29T02:45:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
17562026-10-29T02:45:38.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17572026-10-29T02:45:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
17582026-10-29T02:45:38.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
17592026-10-29T02:45:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
17602026-10-29T02:45:38.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
17612026-10-29T02:45:38.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.11046ms iteration = 86 status = {"config_updated":false}
17622026-10-29T02:45:40.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 152 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 96546a7a-4f16-4b27-ae7a-f1276b407e34 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
17632026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 87 reason = Timeout
17642026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
17652026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
17662026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17672026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
17682026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17692026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
17702026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
17712026-10-29T02:45:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17722026-10-29T02:45:43.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732026-10-29T02:45:43.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17742026-10-29T02:45:43.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17752026-10-29T02:45:43.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17762026-10-29T02:45:43.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.81498ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17772026-10-29T02:45:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
17782026-10-29T02:45:43.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
17792026-10-29T02:45:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
17802026-10-29T02:45:43.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17812026-10-29T02:45:43.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17822026-10-29T02:45:43.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
17832026-10-29T02:45:43.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
17842026-10-29T02:45:43.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.704131ms iteration = 87 status = {"config_updated":false}
17852026-10-29T02:45:43.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17862026-10-29T02:45:43.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
17872026-10-29T02:45:43.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882026-10-29T02:45:43.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
17892026-10-29T02:45:43.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17902026-10-29T02:45:43.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
17912026-10-29T02:45:43.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
17922026-10-29T02:45:43.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.195186ms iteration = 44 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
17932026-10-29T02:45:48.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 88 reason = Timeout
17942026-10-29T02:45:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
17952026-10-29T02:45:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 32 reason = Timeout
17962026-10-29T02:45:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
17972026-10-29T02:45:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 40 reason = Timeout
17982026-10-29T02:45:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 30 reason = Timeout
17992026-10-29T02:45:48.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
18002026-10-29T02:45:48.727ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
18012026-10-29T02:45:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
18022026-10-29T02:45:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
18032026-10-29T02:45:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
18042026-10-29T02:45:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
18052026-10-29T02:45:48.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062026-10-29T02:45:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072026-10-29T02:45:48.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082026-10-29T02:45:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18092026-10-29T02:45:48.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
18102026-10-29T02:45:48.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
18112026-10-29T02:45:48.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
18122026-10-29T02:45:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
18132026-10-29T02:45:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
18142026-10-29T02:45:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
18152026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
18162026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
18172026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
18182026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
18192026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
18202026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
18212026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
18222026-10-29T02:45:48.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.577809ms iteration = 32 status = {"Loaded":{"time_loaded":"2026-10-29T02:45:48.726213131Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
18232026-10-29T02:45:48.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
18242026-10-29T02:45:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.350955ms iteration = 88 status = {"config_updated":false}
18252026-10-29T02:45:48.736ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
18262026-10-29T02:45:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.311165ms iteration = 30 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
18272026-10-29T02:45:48.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 original_time_started = 2026-10-29 02:45:34.796122 UTC
18282026-10-29T02:45:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.710952ms iteration = 40 status = {"Loaded":{"collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","time_loaded":"2026-10-29T02:45:48.726494907Z","time_started":"2026-10-29T02:45:34.796122Z"}}
18292026-10-29T02:45:50.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 123 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 56179cdd-6d89-418b-976b-43f58d2924d5 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
18302026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 89 reason = Timeout
18312026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
18322026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
18332026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18342026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
18352026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18362026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
18372026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18382026-10-29T02:45:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18392026-10-29T02:45:53.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18402026-10-29T02:45:53.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18412026-10-29T02:45:53.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18422026-10-29T02:45:53.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432026-10-29T02:45:53.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.573845ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18442026-10-29T02:45:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
18452026-10-29T02:45:53.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
18462026-10-29T02:45:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
18472026-10-29T02:45:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18482026-10-29T02:45:53.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18492026-10-29T02:45:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18502026-10-29T02:45:53.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
18512026-10-29T02:45:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.215272ms iteration = 89 status = {"config_updated":false}
18522026-10-29T02:45:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18532026-10-29T02:45:53.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18542026-10-29T02:45:53.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552026-10-29T02:45:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
18562026-10-29T02:45:53.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18572026-10-29T02:45:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18582026-10-29T02:45:53.760ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
18592026-10-29T02:45:53.760ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.741542ms iteration = 45 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
18602026-10-29T02:45:58.727ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 90 reason = Timeout
18612026-10-29T02:45:58.727ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
18622026-10-29T02:45:58.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
18632026-10-29T02:45:58.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642026-10-29T02:45:58.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
18652026-10-29T02:45:58.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
18662026-10-29T02:45:58.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
18672026-10-29T02:45:58.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
18682026-10-29T02:45:58.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.519838ms iteration = 90 status = {"config_updated":false}
18692026-10-29T02:46:00.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 170 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = e44392d9-3c86-431c-b4af-1ff1391bec17 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
18702026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 91 reason = Timeout
18712026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
18722026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
18732026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18742026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
18752026-10-29T02:46:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18762026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18772026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
18782026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 16 reason = Timeout
18792026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 41 reason = Timeout
18802026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
18812026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18822026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
18832026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
18842026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18852026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 33 reason = Timeout
18862026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
18872026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18882026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
18892026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
18902026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 16 reason = Timeout
18912026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
18932026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
18942026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18952026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 16 reason = Timeout
18962026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18972026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
18982026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
18992026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19002026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 31 reason = Timeout
19012026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19022026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
19032026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
19042026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19052026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
19062026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19072026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
19082026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
19092026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
19102026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
19112026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19122026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
19132026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19142026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19152026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19162026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
19172026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
19182026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19192026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19202026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19212026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
19222026-10-29T02:46:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
19232026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
19242026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
19252026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19262026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19272026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19282026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
19292026-10-29T02:46:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 405021564 } })
19302026-10-29T02:46:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 405015154 } })
19312026-10-29T02:46:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 405021544 } })
19322026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19332026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
19342026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
19352026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "535ea12f-202b-40c5-b192-a03a1709a604", "content-length": "50", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
19362026-10-29T02:46:03.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19372026-10-29T02:46:03.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
19382026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.658124ms iteration = 16 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
19392026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f046b2-20c8-4283-b4da-7e14582da240", "content-length": "50", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
19402026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
19412026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
19422026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "90937921-ddb6-42b7-a8b9-634f28762801", "content-length": "681", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
19432026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
19452026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
19462026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
19472026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
19482026-10-29T02:46:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
19492026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
19502026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
19512026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19522026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19562026-10-29T02:46:03.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572026-10-29T02:46:03.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.774969ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
19582026-10-29T02:46:03.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592026-10-29T02:46:03.730ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
19602026-10-29T02:46:03.730ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19612026-10-29T02:46:03.730ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 408836654 } })
19622026-10-29T02:46:03.731ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
19632026-10-29T02:46:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 5.334061ms iteration = 16 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
19642026-10-29T02:46:03.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
19652026-10-29T02:46:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.028865ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19662026-10-29T02:46:03.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
19672026-10-29T02:46:03.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
19682026-10-29T02:46:03.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19692026-10-29T02:46:03.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
19702026-10-29T02:46:03.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19712026-10-29T02:46:03.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
19722026-10-29T02:46:03.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.156611ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19732026-10-29T02:46:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19742026-10-29T02:46:03.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19752026-10-29T02:46:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19762026-10-29T02:46:03.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19772026-10-29T02:46:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19782026-10-29T02:46:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19792026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
19802026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
19812026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
19822026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
19832026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
19842026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
19852026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
19862026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
19872026-10-29T02:46:03.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19882026-10-29T02:46:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
19892026-10-29T02:46:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19902026-10-29T02:46:03.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19912026-10-29T02:46:03.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
19922026-10-29T02:46:03.740ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
19932026-10-29T02:46:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19942026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
19952026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
19962026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
19972026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
19982026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
19992026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20002026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
20012026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
20022026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20032026-10-29T02:46:03.741ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20042026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
20052026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
20062026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20072026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20082026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20092026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
20102026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20112026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20122026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
20132026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
20142026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 16.442642ms iteration = 33 status = {"Loaded":{"time_loaded":"2026-10-29T02:46:03.726326057Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
20152026-10-29T02:46:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
20162026-10-29T02:46:03.743ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
20172026-10-29T02:46:03.743ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 16.944682ms iteration = 91 status = {"config_updated":false}
20182026-10-29T02:46:03.743ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "921f4f4e-ef69-438a-9cef-18e1bd8f7e58", "content-length": "81", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
20192026-10-29T02:46:03.744ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20202026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20212026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20222026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
20232026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 18.573876ms iteration = 31 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
20242026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20252026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20272026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 original_time_started = 2026-10-29 02:45:34.796122 UTC
20282026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20292026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 19.067676ms iteration = 41 status = {"Loaded":{"collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","time_loaded":"2026-10-29T02:46:03.726273636Z","time_started":"2026-10-29T02:45:34.796122Z"}}
20302026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
20312026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
20322026-10-29T02:46:03.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20332026-10-29T02:46:03.746ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0eee551-7798-42cc-aceb-cc6b66c41156", "content-length": "81", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
20342026-10-29T02:46:03.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20352026-10-29T02:46:03.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20362026-10-29T02:46:03.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
20372026-10-29T02:46:03.747ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20382026-10-29T02:46:03.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20392026-10-29T02:46:03.749ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20402026-10-29T02:46:03.749ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20412026-10-29T02:46:03.749ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "02c5759e-15aa-4d39-a0b9-f8022a7b14e7", "content-length": "372", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
20422026-10-29T02:46:03.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20432026-10-29T02:46:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20442026-10-29T02:46:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20452026-10-29T02:46:03.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20462026-10-29T02:46:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20472026-10-29T02:46:03.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20482026-10-29T02:46:03.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20492026-10-29T02:46:03.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20502026-10-29T02:46:03.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20512026-10-29T02:46:03.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20522026-10-29T02:46:03.752ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20532026-10-29T02:46:03.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
20542026-10-29T02:46:03.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20552026-10-29T02:46:03.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562026-10-29T02:46:03.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
20572026-10-29T02:46:03.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20582026-10-29T02:46:03.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
20592026-10-29T02:46:03.758ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
20602026-10-29T02:46:03.758ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 32.294731ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20612026-10-29T02:46:03.759ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20622026-10-29T02:46:03.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20632026-10-29T02:46:03.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20642026-10-29T02:46:03.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20652026-10-29T02:46:03.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20662026-10-29T02:46:03.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20672026-10-29T02:46:03.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20682026-10-29T02:46:03.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692026-10-29T02:46:03.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20702026-10-29T02:46:03.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20712026-10-29T02:46:03.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20722026-10-29T02:46:03.807ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 80.701357ms iteration = 30 status = {"disks_added":0,"errors":[]}
20732026-10-29T02:46:03.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
20742026-10-29T02:46:03.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.406309ms iteration = 46 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
20752026-10-29T02:46:03.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20762026-10-29T02:46:03.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20772026-10-29T02:46:03.823ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
20782026-10-29T02:46:03.823ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 97.017707ms iteration = 16 status = {"incomplete_bootstore_configs":[]}
20792026-10-29T02:46:03.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20802026-10-29T02:46:03.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20812026-10-29T02:46:03.830ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20822026-10-29T02:46:03.830ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20832026-10-29T02:46:03.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20842026-10-29T02:46:03.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
20852026-10-29T02:46:03.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20862026-10-29T02:46:03.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20872026-10-29T02:46:03.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20882026-10-29T02:46:03.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20892026-10-29T02:46:03.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20902026-10-29T02:46:03.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
20912026-10-29T02:46:03.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 120.328281ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
20922026-10-29T02:46:03.846ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 120.406003ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
20932026-10-29T02:46:03.848ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
20942026-10-29T02:46:03.848ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
20952026-10-29T02:46:03.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20962026-10-29T02:46:03.849ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f0c1c4b-a9a0-4191-b2d6-31b7f3c5dc16", "content-length": "81", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
20972026-10-29T02:46:03.849ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
20982026-10-29T02:46:03.849ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 123.129709ms iteration = 16 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
20992026-10-29T02:46:03.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21002026-10-29T02:46:03.849ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21012026-10-29T02:46:03.849ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 123.517618ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21022026-10-29T02:46:03.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 125.506478ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21032026-10-29T02:46:03.876ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21042026-10-29T02:46:03.876ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21052026-10-29T02:46:03.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "34b60f30-ea49-4cb5-8147-440eee885e80", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
21062026-10-29T02:46:03.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21072026-10-29T02:46:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21082026-10-29T02:46:03.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21092026-10-29T02:46:03.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21102026-10-29T02:46:03.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21112026-10-29T02:46:03.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21122026-10-29T02:46:03.888ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21132026-10-29T02:46:03.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21142026-10-29T02:46:03.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b33e5222-d1bd-46f4-bd88-a25b74ab9fe6", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
21152026-10-29T02:46:03.888ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 162.63263ms iteration = 24 status = {}
21162026-10-29T02:46:03.898ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21172026-10-29T02:46:03.898ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21182026-10-29T02:46:03.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21192026-10-29T02:46:03.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
21202026-10-29T02:46:03.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21212026-10-29T02:46:03.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21222026-10-29T02:46:03.901ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21232026-10-29T02:46:03.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21242026-10-29T02:46:03.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.171131ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21252026-10-29T02:46:03.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 176.776725ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21262026-10-29T02:46:03.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 221.485394ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21272026-10-29T02:46:03.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21282026-10-29T02:46:03.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21292026-10-29T02:46:03.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21302026-10-29T02:46:03.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21312026-10-29T02:46:03.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21322026-10-29T02:46:03.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21332026-10-29T02:46:03.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342026-10-29T02:46:03.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21352026-10-29T02:46:03.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21362026-10-29T02:46:03.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
21372026-10-29T02:46:03.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
21382026-10-29T02:46:03.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38383688-aab3-4a08-a973-40e49cc725b3", "content-length": "691", "date": "Thu, 29 Oct 2026 02:46:03 GMT"} })
21392026-10-29T02:46:03.977ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
21402026-10-29T02:46:03.977ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
21412026-10-29T02:46:03.977ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
21422026-10-29T02:46:03.977ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 244.611194ms iteration = 16 status = {}
21432026-10-29T02:46:04.188ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = b631d7e1-7dac-4a72-8a22-ff6c20885514 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
21442026-10-29T02:46:04.188ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = b631d7e1-7dac-4a72-8a22-ff6c20885514 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
21452026-10-29T02:46:04.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = b631d7e1-7dac-4a72-8a22-ff6c20885514 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
21462026-10-29T02:46:04.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 4246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = b631d7e1-7dac-4a72-8a22-ff6c20885514 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
21472026-10-29T02:46:04.192ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 36ac6935-74c1-406c-b470-28f172f1d98e uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
21482026-10-29T02:46:04.192ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 36ac6935-74c1-406c-b470-28f172f1d98e roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
21492026-10-29T02:46:04.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 36ac6935-74c1-406c-b470-28f172f1d98e resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
21502026-10-29T02:46:04.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 36ac6935-74c1-406c-b470-28f172f1d98e response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
21512026-10-29T02:46:08.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 92 reason = Timeout
21522026-10-29T02:46:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
21532026-10-29T02:46:08.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
21542026-10-29T02:46:08.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21552026-10-29T02:46:08.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
21562026-10-29T02:46:08.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
21572026-10-29T02:46:08.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
21582026-10-29T02:46:08.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
21592026-10-29T02:46:08.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.382135ms iteration = 92 status = {"config_updated":false}
21602026-10-29T02:46:10.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 117 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = b042f458-f7f4-4794-94cb-47049d8f5de5 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
21612026-10-29T02:46:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 93 reason = Timeout
21622026-10-29T02:46:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
21632026-10-29T02:46:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
21642026-10-29T02:46:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
21652026-10-29T02:46:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21662026-10-29T02:46:13.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21672026-10-29T02:46:13.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
21682026-10-29T02:46:13.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21692026-10-29T02:46:13.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21702026-10-29T02:46:13.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21712026-10-29T02:46:13.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21722026-10-29T02:46:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21732026-10-29T02:46:13.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21742026-10-29T02:46:13.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.033064ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21752026-10-29T02:46:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
21762026-10-29T02:46:13.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
21772026-10-29T02:46:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
21782026-10-29T02:46:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21792026-10-29T02:46:13.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21802026-10-29T02:46:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21812026-10-29T02:46:13.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
21822026-10-29T02:46:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.805273ms iteration = 93 status = {"config_updated":false}
21832026-10-29T02:46:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842026-10-29T02:46:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852026-10-29T02:46:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21862026-10-29T02:46:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
21872026-10-29T02:46:13.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21882026-10-29T02:46:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21892026-10-29T02:46:13.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
21902026-10-29T02:46:13.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.927894ms iteration = 47 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
21912026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 94 reason = Timeout
21922026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
21932026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 32 reason = Timeout
21942026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
21952026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 34 reason = Timeout
21962026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 42 reason = Timeout
21972026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
21982026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
21992026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
22002026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
22012026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
22022026-10-29T02:46:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
22032026-10-29T02:46:18.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22042026-10-29T02:46:18.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22052026-10-29T02:46:18.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22062026-10-29T02:46:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22072026-10-29T02:46:18.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
22082026-10-29T02:46:18.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
22092026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
22102026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
22112026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
22122026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
22132026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
22142026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
22152026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
22162026-10-29T02:46:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
22172026-10-29T02:46:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
22182026-10-29T02:46:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
22192026-10-29T02:46:18.736ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
22202026-10-29T02:46:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 10.467148ms iteration = 34 status = {"Loaded":{"time_loaded":"2026-10-29T02:46:18.726207420Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
22212026-10-29T02:46:18.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
22222026-10-29T02:46:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.5722ms iteration = 94 status = {"config_updated":false}
22232026-10-29T02:46:18.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
22242026-10-29T02:46:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.874296ms iteration = 32 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
22252026-10-29T02:46:18.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 original_time_started = 2026-10-29 02:45:34.796122 UTC
22262026-10-29T02:46:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.893866ms iteration = 42 status = {"Loaded":{"collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","time_loaded":"2026-10-29T02:46:18.726223040Z","time_started":"2026-10-29T02:45:34.796122Z"}}
22272026-10-29T02:46:19.187ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 06b8b671-6135-44e8-a089-945c741597ed uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
22282026-10-29T02:46:19.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 06b8b671-6135-44e8-a089-945c741597ed roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
22292026-10-29T02:46:19.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 06b8b671-6135-44e8-a089-945c741597ed resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
22302026-10-29T02:46:19.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 06b8b671-6135-44e8-a089-945c741597ed response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
22312026-10-29T02:46:19.190ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0704d019-7be5-49e0-900f-c79c28229ee3 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
22322026-10-29T02:46:19.190ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0704d019-7be5-49e0-900f-c79c28229ee3 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
22332026-10-29T02:46:19.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0704d019-7be5-49e0-900f-c79c28229ee3 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
22342026-10-29T02:46:19.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0704d019-7be5-49e0-900f-c79c28229ee3 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
22352026-10-29T02:46:20.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 169 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = c626848b-27be-48e7-a669-abfa3e764c78 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
22362026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 95 reason = Timeout
22372026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
22382026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
22392026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
22402026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22412026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22422026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
22432026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
22442026-10-29T02:46:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22452026-10-29T02:46:23.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22462026-10-29T02:46:23.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22472026-10-29T02:46:23.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22482026-10-29T02:46:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22492026-10-29T02:46:23.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.694168ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22502026-10-29T02:46:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22512026-10-29T02:46:23.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22522026-10-29T02:46:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
22532026-10-29T02:46:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
22542026-10-29T02:46:23.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
22552026-10-29T02:46:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
22562026-10-29T02:46:23.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
22572026-10-29T02:46:23.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.103249ms iteration = 95 status = {"config_updated":false}
22582026-10-29T02:46:23.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22592026-10-29T02:46:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
22602026-10-29T02:46:23.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22612026-10-29T02:46:23.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
22622026-10-29T02:46:23.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22632026-10-29T02:46:23.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
22642026-10-29T02:46:23.761ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
22652026-10-29T02:46:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.837665ms iteration = 48 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
22662026-10-29T02:46:28.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 96 reason = Timeout
22672026-10-29T02:46:28.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
22682026-10-29T02:46:28.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
22692026-10-29T02:46:28.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22702026-10-29T02:46:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
22712026-10-29T02:46:28.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
22722026-10-29T02:46:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
22732026-10-29T02:46:28.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
22742026-10-29T02:46:28.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.283782ms iteration = 96 status = {"config_updated":false}
22752026-10-29T02:46:30.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 160 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = f690eebc-8e14-4c61-98a5-4b2a0448aab4 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
22762026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 97 reason = Timeout
22772026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
22782026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 17 reason = Timeout
22792026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 24 reason = Timeout
22802026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
22812026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
22822026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 17 reason = Timeout
22832026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
22842026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22852026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 9 reason = Timeout
22862026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 23 reason = Timeout
22872026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
22882026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
22892026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22902026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
22912026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
22922026-10-29T02:46:33.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:36:33.726198584 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22932026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 43 reason = Timeout
22942026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22952026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
22962026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22972026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
22982026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
22992026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23002026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 35 reason = Timeout
23012026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
23022026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
23032026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 23 reason = Timeout
23042026-10-29T02:46:33.726ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
23052026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 13.89\u{b5}s iteration = 23 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
23062026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 33 reason = Timeout
23072026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
23082026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 9 reason = Timeout
23092026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
23102026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
23112026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 9 reason = Timeout
23122026-10-29T02:46:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
23132026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
23142026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 25 reason = Timeout
23152026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23162026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
23172026-10-29T02:46:33.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23182026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
23192026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
23202026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23212026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
23222026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
23232026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23242026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23252026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 9 reason = Timeout
23262026-10-29T02:46:33.726ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
23272026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
23282026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 17 reason = Timeout
23292026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
23302026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
23312026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23322026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
23332026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23342026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
23352026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23362026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23372026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
23382026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23392026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
23402026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
23412026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
23422026-10-29T02:46:33.726ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
23432026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
23442026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
23452026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
23462026-10-29T02:46:33.726ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = ExternalNetworking step id = Ensure
23472026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23482026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
23492026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
23502026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23512026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
23522026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23532026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
23542026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23552026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
23562026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
23572026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23582026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23592026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23602026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 9 reason = Timeout
23612026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
23622026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
23632026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23642026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
23652026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
23662026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23672026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23682026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23692026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
23702026-10-29T02:46:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
23712026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23722026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
23732026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23742026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
23752026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
23762026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23772026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
23782026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23792026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
23802026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
23812026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
23822026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23832026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
23842026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
23852026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23862026-10-29T02:46:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 405258447 } })
23872026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
23882026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23892026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
23902026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23912026-10-29T02:46:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 405291408 } })
23922026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23932026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
23942026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
23952026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
23962026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23972026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23982026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23992026-10-29T02:46:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 405388130 } })
24002026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
24012026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "99d3ec3f-cfd0-41fb-8e2b-7e7eed8461b7", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24022026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24032026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
24042026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24052026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d217a377-8e3f-4f9c-8034-4c34bf2b1c88", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24062026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24072026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24082026-10-29T02:46:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 405471052 } })
24092026-10-29T02:46:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 405513623 } })
24102026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8e793b2c-baa6-4c8f-bd69-95bf708146ce", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24112026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24122026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.245685ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24132026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5133ee33-1625-4b2c-ba6a-76221837626d", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24142026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24152026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0e2ae5ca-b7b9-4c04-979e-0a47f3b489d6", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24162026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24172026-10-29T02:46:33.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24182026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.179545ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24192026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
24202026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24212026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.580493ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24222026-10-29T02:46:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
24232026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
24242026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.9357ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
24252026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe9d95e5-d036-40c1-aa7d-273919ec4faa", "content-length": "50", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
24262026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24272026-10-29T02:46:33.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
24282026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 2.069593ms iteration = 17 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
24292026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d74f741-cb72-4512-8449-0959bfdb960a", "content-length": "50", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
24302026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
24312026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
24322026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5f61f89-5245-4e16-826d-be28a86be32a", "content-length": "681", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
24332026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
24342026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
24352026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
24362026-10-29T02:46:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
24372026-10-29T02:46:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
24382026-10-29T02:46:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
24392026-10-29T02:46:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
24402026-10-29T02:46:33.729ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24412026-10-29T02:46:33.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24422026-10-29T02:46:33.729ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24432026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24462026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.944822ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
24472026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24482026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24492026-10-29T02:46:33.730ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
24502026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 4.643707ms iteration = 24 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
24512026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24522026-10-29T02:46:33.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532026-10-29T02:46:33.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24542026-10-29T02:46:33.731ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24552026-10-29T02:46:33.731ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24562026-10-29T02:46:33.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24572026-10-29T02:46:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24582026-10-29T02:46:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
24592026-10-29T02:46:33.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
24602026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24612026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24622026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.678028ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24632026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24652026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
24662026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24672026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
24682026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24692026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24702026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
24712026-10-29T02:46:33.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
24722026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24732026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 9 reason = Timeout
24742026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
24752026-10-29T02:46:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
24762026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.786501ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
24772026-10-29T02:46:33.733ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:36:33.726198584 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24782026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.838342ms iteration = 9 status = {"expiration":"2026-10-29T02:36:33.726198584Z","pruned":[]}
24792026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.623178ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
24802026-10-29T02:46:33.733ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
24812026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 7.032406ms iteration = 9 status = {"by_rx":{},"error":null}
24822026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
24832026-10-29T02:46:33.733ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 411565658 } })
24842026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24852026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24862026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24872026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
24882026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.524987ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
24892026-10-29T02:46:33.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24902026-10-29T02:46:33.734ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
24912026-10-29T02:46:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24922026-10-29T02:46:33.734ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
24932026-10-29T02:46:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 8.021747ms iteration = 17 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
24942026-10-29T02:46:33.734ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952026-10-29T02:46:33.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24962026-10-29T02:46:33.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24972026-10-29T02:46:33.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24982026-10-29T02:46:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24992026-10-29T02:46:33.735ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002026-10-29T02:46:33.735ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012026-10-29T02:46:33.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022026-10-29T02:46:33.736ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
25032026-10-29T02:46:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
25042026-10-29T02:46:33.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
25052026-10-29T02:46:33.740ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
25062026-10-29T02:46:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
25072026-10-29T02:46:33.741ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 14.853449ms iteration = 9 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
25082026-10-29T02:46:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
25092026-10-29T02:46:33.742ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
25102026-10-29T02:46:33.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25112026-10-29T02:46:33.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25122026-10-29T02:46:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
25132026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25142026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25152026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25162026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25172026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25182026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25192026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25202026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25212026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
25222026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25232026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25242026-10-29T02:46:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25252026-10-29T02:46:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
25262026-10-29T02:46:33.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
25272026-10-29T02:46:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25282026-10-29T02:46:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
25292026-10-29T02:46:33.746ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
25302026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25312026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25322026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
25332026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
25342026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
25352026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
25362026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
25372026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25382026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25392026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25402026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
25412026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25422026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
25432026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
25442026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25452026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
25462026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
25472026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25482026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
25492026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25502026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
25512026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
25522026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25532026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
25542026-10-29T02:46:33.748ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
25552026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
25562026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
25572026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
25582026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
25592026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
25602026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
25612026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25622026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
25632026-10-29T02:46:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
25642026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
25652026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25662026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
25672026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25682026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25692026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
25702026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
25712026-10-29T02:46:33.750ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
25722026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
25732026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
25742026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
25752026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25762026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25772026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25782026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25792026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25802026-10-29T02:46:33.751ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf6b0837-27a2-477a-9023-fb58823b3a93", "content-length": "81", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
25812026-10-29T02:46:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25822026-10-29T02:46:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25832026-10-29T02:46:33.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842026-10-29T02:46:33.755ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25852026-10-29T02:46:33.755ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25862026-10-29T02:46:33.756ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25872026-10-29T02:46:33.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25882026-10-29T02:46:33.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25892026-10-29T02:46:33.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25902026-10-29T02:46:33.759ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
25912026-10-29T02:46:33.759ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 33.084717ms iteration = 35 status = {"Loaded":{"time_loaded":"2026-10-29T02:46:33.726255465Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
25922026-10-29T02:46:33.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25932026-10-29T02:46:33.762ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
25942026-10-29T02:46:33.762ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 36.750635ms iteration = 97 status = {"config_updated":false}
25952026-10-29T02:46:33.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
25962026-10-29T02:46:33.762ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
25972026-10-29T02:46:33.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
25982026-10-29T02:46:33.764ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
25992026-10-29T02:46:33.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26002026-10-29T02:46:33.764ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26012026-10-29T02:46:33.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26022026-10-29T02:46:33.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
26032026-10-29T02:46:33.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
26042026-10-29T02:46:33.767ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26052026-10-29T02:46:33.767ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.119465ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26062026-10-29T02:46:33.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26072026-10-29T02:46:33.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26082026-10-29T02:46:33.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26092026-10-29T02:46:33.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26102026-10-29T02:46:33.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26112026-10-29T02:46:33.777ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26122026-10-29T02:46:33.777ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26132026-10-29T02:46:33.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26142026-10-29T02:46:33.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26152026-10-29T02:46:33.778ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26162026-10-29T02:46:33.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26172026-10-29T02:46:33.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26182026-10-29T02:46:33.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26192026-10-29T02:46:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26202026-10-29T02:46:33.779ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e471b44-bd02-4ff2-bbd1-98bff7043c0e", "content-length": "372", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
26212026-10-29T02:46:33.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26222026-10-29T02:46:33.780ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
26232026-10-29T02:46:33.780ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
26242026-10-29T02:46:33.780ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 original_time_started = 2026-10-29 02:45:34.796122 UTC
26252026-10-29T02:46:33.780ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 54.228737ms iteration = 43 status = {"Loaded":{"collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","time_loaded":"2026-10-29T02:46:33.726218404Z","time_started":"2026-10-29T02:45:34.796122Z"}}
26262026-10-29T02:46:33.781ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "350d6378-4d39-4269-8ef7-95e998f40e26", "content-length": "81", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
26272026-10-29T02:46:33.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26282026-10-29T02:46:33.782ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
26292026-10-29T02:46:33.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
26302026-10-29T02:46:33.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
26312026-10-29T02:46:33.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26322026-10-29T02:46:33.787ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
26332026-10-29T02:46:33.787ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 54.901921ms iteration = 9 status = {"samples_queued":6}
26342026-10-29T02:46:33.787ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 61.481247ms iteration = 33 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
26352026-10-29T02:46:33.787ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
26362026-10-29T02:46:33.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
26372026-10-29T02:46:33.792ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
26382026-10-29T02:46:33.793ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 66.277068ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26392026-10-29T02:46:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
26402026-10-29T02:46:33.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26412026-10-29T02:46:33.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26422026-10-29T02:46:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
26432026-10-29T02:46:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
26442026-10-29T02:46:33.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26452026-10-29T02:46:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
26462026-10-29T02:46:33.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26472026-10-29T02:46:33.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26482026-10-29T02:46:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26492026-10-29T02:46:33.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
26502026-10-29T02:46:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
26512026-10-29T02:46:33.799ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
26522026-10-29T02:46:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
26532026-10-29T02:46:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26542026-10-29T02:46:33.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26552026-10-29T02:46:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26562026-10-29T02:46:33.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26572026-10-29T02:46:33.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
26582026-10-29T02:46:33.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26592026-10-29T02:46:33.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26602026-10-29T02:46:33.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26612026-10-29T02:46:33.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
26622026-10-29T02:46:33.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
26632026-10-29T02:46:33.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
26642026-10-29T02:46:33.842ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26652026-10-29T02:46:33.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
26662026-10-29T02:46:33.851ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
26672026-10-29T02:46:33.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
26682026-10-29T02:46:33.855ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26692026-10-29T02:46:33.855ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26702026-10-29T02:46:33.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26712026-10-29T02:46:33.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26722026-10-29T02:46:33.876ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
26732026-10-29T02:46:33.876ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
26742026-10-29T02:46:33.876ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 150.034358ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
26752026-10-29T02:46:33.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26762026-10-29T02:46:33.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26772026-10-29T02:46:33.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26782026-10-29T02:46:33.884ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
26792026-10-29T02:46:33.884ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 158.28079ms iteration = 49 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
26802026-10-29T02:46:33.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
26812026-10-29T02:46:33.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26822026-10-29T02:46:33.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26832026-10-29T02:46:33.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26842026-10-29T02:46:33.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 174.044178ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26852026-10-29T02:46:33.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26862026-10-29T02:46:33.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 178.129633ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26872026-10-29T02:46:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26882026-10-29T02:46:33.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26892026-10-29T02:46:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26902026-10-29T02:46:33.908ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
26912026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26922026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
26932026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
26942026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "2244b635-1ddd-41b0-8282-0dbb9d2936ad", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
26952026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
26962026-10-29T02:46:33.909ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
26972026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 183.112316ms iteration = 9 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
26982026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26992026-10-29T02:46:33.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
27002026-10-29T02:46:33.915ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
27012026-10-29T02:46:33.916ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27022026-10-29T02:46:33.916ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
27032026-10-29T02:46:33.916ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 183.173617ms iteration = 9 status = {"generation":1}
27042026-10-29T02:46:33.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
27052026-10-29T02:46:33.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
27062026-10-29T02:46:33.919ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27072026-10-29T02:46:33.919ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27082026-10-29T02:46:33.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27092026-10-29T02:46:33.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
27102026-10-29T02:46:33.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112026-10-29T02:46:33.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27122026-10-29T02:46:33.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
27132026-10-29T02:46:33.927ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27142026-10-29T02:46:33.928ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27152026-10-29T02:46:33.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 201.5782ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27162026-10-29T02:46:33.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
27172026-10-29T02:46:33.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
27182026-10-29T02:46:33.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
27192026-10-29T02:46:33.931ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27202026-10-29T02:46:33.931ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
27212026-10-29T02:46:33.931ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 198.322772ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27222026-10-29T02:46:33.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 205.929201ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27232026-10-29T02:46:33.933ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27242026-10-29T02:46:33.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27252026-10-29T02:46:33.934ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27262026-10-29T02:46:33.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27272026-10-29T02:46:33.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
27282026-10-29T02:46:33.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
27292026-10-29T02:46:33.936ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
27302026-10-29T02:46:33.936ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
27312026-10-29T02:46:33.937ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2eff5e8-861a-40f5-a7b1-4c6208480880", "content-length": "81", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
27322026-10-29T02:46:33.937ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
27332026-10-29T02:46:33.937ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 211.310332ms iteration = 17 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
27342026-10-29T02:46:33.938ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27352026-10-29T02:46:33.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362026-10-29T02:46:33.941ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
27372026-10-29T02:46:33.941ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 215.093191ms iteration = 9 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
27382026-10-29T02:46:33.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
27392026-10-29T02:46:33.944ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27402026-10-29T02:46:33.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27412026-10-29T02:46:33.946ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
27422026-10-29T02:46:33.954ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27432026-10-29T02:46:33.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27442026-10-29T02:46:33.956ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
27452026-10-29T02:46:33.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27462026-10-29T02:46:33.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27472026-10-29T02:46:33.963ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27482026-10-29T02:46:33.966ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
27492026-10-29T02:46:33.970ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
27502026-10-29T02:46:33.970ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 244.144865ms iteration = 17 status = {"incomplete_bootstore_configs":[]}
27512026-10-29T02:46:33.971ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
27522026-10-29T02:46:33.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
27532026-10-29T02:46:33.972ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27542026-10-29T02:46:33.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
27552026-10-29T02:46:33.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27562026-10-29T02:46:33.972ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 650594517 } })
27572026-10-29T02:46:33.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
27582026-10-29T02:46:33.973ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27592026-10-29T02:46:33.973ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27602026-10-29T02:46:33.973ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27612026-10-29T02:46:33.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27622026-10-29T02:46:33.974ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 247.899153ms iteration = 9 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
27632026-10-29T02:46:33.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27642026-10-29T02:46:33.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652026-10-29T02:46:33.977ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27662026-10-29T02:46:33.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27672026-10-29T02:46:33.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27682026-10-29T02:46:33.981ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692026-10-29T02:46:33.984ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
27702026-10-29T02:46:33.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27712026-10-29T02:46:33.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27722026-10-29T02:46:33.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
27732026-10-29T02:46:33.987ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27742026-10-29T02:46:33.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27752026-10-29T02:46:33.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27762026-10-29T02:46:33.988ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
27772026-10-29T02:46:33.990ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27782026-10-29T02:46:33.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27792026-10-29T02:46:33.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "96fa12d6-ba52-4908-b032-460a9b2e065c", "date": "Thu, 29 Oct 2026 02:46:33 GMT"} })
27802026-10-29T02:46:33.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27812026-10-29T02:46:33.991ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
27822026-10-29T02:46:33.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27832026-10-29T02:46:33.991ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
27842026-10-29T02:46:33.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
27852026-10-29T02:46:33.992ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
27862026-10-29T02:46:33.992ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
27872026-10-29T02:46:33.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27882026-10-29T02:46:33.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27892026-10-29T02:46:33.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902026-10-29T02:46:33.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
27912026-10-29T02:46:33.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
27922026-10-29T02:46:33.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27932026-10-29T02:46:33.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27942026-10-29T02:46:34.003ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27952026-10-29T02:46:34.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962026-10-29T02:46:34.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27972026-10-29T02:46:34.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27982026-10-29T02:46:34.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27992026-10-29T02:46:34.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28002026-10-29T02:46:34.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28012026-10-29T02:46:34.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28022026-10-29T02:46:34.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28032026-10-29T02:46:34.009ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
28042026-10-29T02:46:34.009ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28052026-10-29T02:46:34.009ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
28062026-10-29T02:46:34.009ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 283.450711ms iteration = 9 status = {"generation":2}
28072026-10-29T02:46:34.010ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
28082026-10-29T02:46:34.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
28092026-10-29T02:46:34.010ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
28102026-10-29T02:46:34.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
28112026-10-29T02:46:34.011ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122026-10-29T02:46:34.012ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
28132026-10-29T02:46:34.013ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28142026-10-29T02:46:34.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28152026-10-29T02:46:34.013ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
28162026-10-29T02:46:34.013ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
28172026-10-29T02:46:34.014ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62b4dfb6-224a-438b-89d7-3c58854d5d4e", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
28182026-10-29T02:46:34.014ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.944305ms iteration = 25 status = {}
28192026-10-29T02:46:34.014ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Dependency
28202026-10-29T02:46:34.014ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28212026-10-29T02:46:34.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28222026-10-29T02:46:34.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
28232026-10-29T02:46:34.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28242026-10-29T02:46:34.015ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
28252026-10-29T02:46:34.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28262026-10-29T02:46:34.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28272026-10-29T02:46:34.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28282026-10-29T02:46:34.017ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28292026-10-29T02:46:34.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28302026-10-29T02:46:34.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28312026-10-29T02:46:34.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28322026-10-29T02:46:34.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
28332026-10-29T02:46:34.023ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
28342026-10-29T02:46:34.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
28352026-10-29T02:46:34.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28362026-10-29T02:46:34.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28372026-10-29T02:46:34.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28382026-10-29T02:46:34.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28392026-10-29T02:46:34.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28402026-10-29T02:46:34.028ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
28412026-10-29T02:46:34.028ZINFOnexus (BackgroundTasks): building sitrep c5c687bc-f5d6-4d0e-bc24-0b71c057cbba (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = c5c687bc-f5d6-4d0e-bc24-0b71c057cbba (sitrep)
28422026-10-29T02:46:34.029ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
28432026-10-29T02:46:34.029ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 302.909996ms iteration = 23 status = {"inv_collection_id":"9a208e82-0cd9-43d2-8b54-25502e463b14","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:46:34.029004027Z","outcome":"Unchanged","start_time":"2026-10-29T02:46:34.028846034Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
28442026-10-29T02:46:34.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28452026-10-29T02:46:34.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28462026-10-29T02:46:34.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28472026-10-29T02:46:34.032ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
28482026-10-29T02:46:34.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 307.667955ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28492026-10-29T02:46:34.040ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
28502026-10-29T02:46:34.040ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 313.904444ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28512026-10-29T02:46:34.042ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
28522026-10-29T02:46:34.043ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28532026-10-29T02:46:34.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28542026-10-29T02:46:34.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
28552026-10-29T02:46:34.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "354063e3-e489-4e55-9bd9-162651b5ca01", "content-length": "372", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
28562026-10-29T02:46:34.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
28572026-10-29T02:46:34.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28582026-10-29T02:46:34.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28592026-10-29T02:46:34.046ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
28602026-10-29T02:46:34.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612026-10-29T02:46:34.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28622026-10-29T02:46:34.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28632026-10-29T02:46:34.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
28642026-10-29T02:46:34.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
28652026-10-29T02:46:34.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
28662026-10-29T02:46:34.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28672026-10-29T02:46:34.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
28682026-10-29T02:46:34.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
28692026-10-29T02:46:34.060ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
28702026-10-29T02:46:34.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28712026-10-29T02:46:34.063ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
28722026-10-29T02:46:34.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
28732026-10-29T02:46:34.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
28742026-10-29T02:46:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
28752026-10-29T02:46:34.065ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
28762026-10-29T02:46:34.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28772026-10-29T02:46:34.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28782026-10-29T02:46:34.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28792026-10-29T02:46:34.075ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
28802026-10-29T02:46:34.079ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
28812026-10-29T02:46:34.081ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
28822026-10-29T02:46:34.082ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = SledList step id = Fetch
28832026-10-29T02:46:34.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28842026-10-29T02:46:34.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28852026-10-29T02:46:34.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28862026-10-29T02:46:34.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
28872026-10-29T02:46:34.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28882026-10-29T02:46:34.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28892026-10-29T02:46:34.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28902026-10-29T02:46:34.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
28912026-10-29T02:46:34.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28922026-10-29T02:46:34.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28932026-10-29T02:46:34.101ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = DeployNexusRecords step id = Ensure
28942026-10-29T02:46:34.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28952026-10-29T02:46:34.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
28962026-10-29T02:46:34.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28972026-10-29T02:46:34.107ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
28982026-10-29T02:46:34.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
28992026-10-29T02:46:34.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29002026-10-29T02:46:34.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29012026-10-29T02:46:34.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29022026-10-29T02:46:34.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29032026-10-29T02:46:34.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29042026-10-29T02:46:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29052026-10-29T02:46:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
29062026-10-29T02:46:34.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29072026-10-29T02:46:34.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
29082026-10-29T02:46:34.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29092026-10-29T02:46:34.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29102026-10-29T02:46:34.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112026-10-29T02:46:34.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
29122026-10-29T02:46:34.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29132026-10-29T02:46:34.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29142026-10-29T02:46:34.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29152026-10-29T02:46:34.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29162026-10-29T02:46:34.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29172026-10-29T02:46:34.183ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29182026-10-29T02:46:34.183ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29192026-10-29T02:46:34.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "77032254-d89a-436e-a398-beac9d1ca21d", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
29202026-10-29T02:46:34.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29212026-10-29T02:46:34.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29222026-10-29T02:46:34.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
29232026-10-29T02:46:34.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29242026-10-29T02:46:34.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29252026-10-29T02:46:34.187ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0d545d67-1ef1-40df-a058-2edb590200a5 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
29262026-10-29T02:46:34.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0d545d67-1ef1-40df-a058-2edb590200a5 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
29272026-10-29T02:46:34.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29282026-10-29T02:46:34.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0d545d67-1ef1-40df-a058-2edb590200a5 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
29292026-10-29T02:46:34.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29302026-10-29T02:46:34.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29312026-10-29T02:46:34.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29322026-10-29T02:46:34.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 4849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 0d545d67-1ef1-40df-a058-2edb590200a5 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
29332026-10-29T02:46:34.193ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 39d9dcc6-48c1-4db3-8f16-649750e4da15 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
29342026-10-29T02:46:34.193ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 39d9dcc6-48c1-4db3-8f16-649750e4da15 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
29352026-10-29T02:46:34.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 39d9dcc6-48c1-4db3-8f16-649750e4da15 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
29362026-10-29T02:46:34.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29372026-10-29T02:46:34.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29382026-10-29T02:46:34.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29392026-10-29T02:46:34.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 39d9dcc6-48c1-4db3-8f16-649750e4da15 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
29402026-10-29T02:46:34.196ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29412026-10-29T02:46:34.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29422026-10-29T02:46:34.197ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "17a7990c-4ade-4b0d-a6e0-39f16451956e", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
29432026-10-29T02:46:34.197ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 183.135706ms iteration = 26 status = {}
29442026-10-29T02:46:34.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
29452026-10-29T02:46:34.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29462026-10-29T02:46:34.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29472026-10-29T02:46:34.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29482026-10-29T02:46:34.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29492026-10-29T02:46:34.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
29502026-10-29T02:46:34.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
29512026-10-29T02:46:34.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29522026-10-29T02:46:34.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
29532026-10-29T02:46:34.211ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = SledAgent step id = Ensure
29542026-10-29T02:46:34.212ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
29552026-10-29T02:46:34.213ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
29562026-10-29T02:46:34.213ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 486.40941ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
29572026-10-29T02:46:34.215ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "572ddbaf-ea74-4808-b0bc-9e9203ffbc54", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
29582026-10-29T02:46:34.215ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = FirewallRules step id = Ensure
29592026-10-29T02:46:34.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29602026-10-29T02:46:34.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29612026-10-29T02:46:34.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29622026-10-29T02:46:34.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29632026-10-29T02:46:34.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29642026-10-29T02:46:34.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29652026-10-29T02:46:34.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29662026-10-29T02:46:34.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29672026-10-29T02:46:34.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29682026-10-29T02:46:34.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29692026-10-29T02:46:34.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29702026-10-29T02:46:34.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29712026-10-29T02:46:34.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722026-10-29T02:46:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
29732026-10-29T02:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29742026-10-29T02:46:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29752026-10-29T02:46:34.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29762026-10-29T02:46:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29772026-10-29T02:46:34.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29782026-10-29T02:46:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29792026-10-29T02:46:34.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29802026-10-29T02:46:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
29812026-10-29T02:46:34.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822026-10-29T02:46:34.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29832026-10-29T02:46:34.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29842026-10-29T02:46:34.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29852026-10-29T02:46:34.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
29862026-10-29T02:46:34.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29872026-10-29T02:46:34.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
29882026-10-29T02:46:34.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29892026-10-29T02:46:34.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29902026-10-29T02:46:34.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29912026-10-29T02:46:34.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29922026-10-29T02:46:34.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
29932026-10-29T02:46:34.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29942026-10-29T02:46:34.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29952026-10-29T02:46:34.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
29962026-10-29T02:46:34.269ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
29972026-10-29T02:46:34.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
29982026-10-29T02:46:34.270ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5934c665-cb46-4850-b8f4-f93286e66ff3", "content-length": "691", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
29992026-10-29T02:46:34.271ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
30002026-10-29T02:46:34.271ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
30012026-10-29T02:46:34.271ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
30022026-10-29T02:46:34.271ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.580303ms iteration = 17 status = {}
30032026-10-29T02:46:34.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30042026-10-29T02:46:34.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30052026-10-29T02:46:34.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30062026-10-29T02:46:34.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30072026-10-29T02:46:34.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30082026-10-29T02:46:34.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30092026-10-29T02:46:34.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30102026-10-29T02:46:34.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30112026-10-29T02:46:34.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30122026-10-29T02:46:34.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30132026-10-29T02:46:34.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30142026-10-29T02:46:34.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30152026-10-29T02:46:34.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30162026-10-29T02:46:34.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30172026-10-29T02:46:34.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
30182026-10-29T02:46:34.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30192026-10-29T02:46:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30202026-10-29T02:46:34.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30212026-10-29T02:46:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30222026-10-29T02:46:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30232026-10-29T02:46:34.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30242026-10-29T02:46:34.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30252026-10-29T02:46:34.295ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 569.66001ms iteration = 31 status = {"disks_added":0,"errors":[]}
30262026-10-29T02:46:34.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30272026-10-29T02:46:34.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
30282026-10-29T02:46:34.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30292026-10-29T02:46:34.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30302026-10-29T02:46:34.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312026-10-29T02:46:34.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30322026-10-29T02:46:34.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30332026-10-29T02:46:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
30342026-10-29T02:46:34.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30352026-10-29T02:46:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30362026-10-29T02:46:34.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30372026-10-29T02:46:34.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30382026-10-29T02:46:34.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30392026-10-29T02:46:34.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30402026-10-29T02:46:34.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30412026-10-29T02:46:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30422026-10-29T02:46:34.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432026-10-29T02:46:34.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30442026-10-29T02:46:34.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30452026-10-29T02:46:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
30462026-10-29T02:46:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30472026-10-29T02:46:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30482026-10-29T02:46:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30492026-10-29T02:46:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30502026-10-29T02:46:34.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30512026-10-29T02:46:34.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30522026-10-29T02:46:34.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30532026-10-29T02:46:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30542026-10-29T02:46:34.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552026-10-29T02:46:34.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30562026-10-29T02:46:34.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30572026-10-29T02:46:34.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30582026-10-29T02:46:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
30592026-10-29T02:46:34.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30602026-10-29T02:46:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30612026-10-29T02:46:34.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30622026-10-29T02:46:34.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30632026-10-29T02:46:34.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30642026-10-29T02:46:34.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
30652026-10-29T02:46:34.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30662026-10-29T02:46:34.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30672026-10-29T02:46:34.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
30682026-10-29T02:46:34.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
30692026-10-29T02:46:34.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
30702026-10-29T02:46:34.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30712026-10-29T02:46:34.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30722026-10-29T02:46:34.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30732026-10-29T02:46:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30742026-10-29T02:46:34.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30752026-10-29T02:46:34.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
30762026-10-29T02:46:34.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30772026-10-29T02:46:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30782026-10-29T02:46:34.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30792026-10-29T02:46:34.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30802026-10-29T02:46:34.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30812026-10-29T02:46:34.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30822026-10-29T02:46:34.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30832026-10-29T02:46:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30842026-10-29T02:46:34.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30852026-10-29T02:46:34.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30862026-10-29T02:46:34.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30872026-10-29T02:46:34.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30882026-10-29T02:46:34.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30892026-10-29T02:46:34.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30902026-10-29T02:46:34.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30912026-10-29T02:46:34.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30922026-10-29T02:46:34.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30932026-10-29T02:46:34.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
30942026-10-29T02:46:34.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30952026-10-29T02:46:34.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30962026-10-29T02:46:34.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30972026-10-29T02:46:34.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
30982026-10-29T02:46:34.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
30992026-10-29T02:46:34.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31002026-10-29T02:46:34.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31012026-10-29T02:46:34.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31022026-10-29T02:46:34.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31032026-10-29T02:46:34.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31042026-10-29T02:46:34.404ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
31052026-10-29T02:46:34.404ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
31062026-10-29T02:46:34.404ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
31072026-10-29T02:46:34.405ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
31082026-10-29T02:46:34.405ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
31092026-10-29T02:46:34.405ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = f95a516f-14ef-4542-aa40-119cf025917d parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
31102026-10-29T02:46:34.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
31112026-10-29T02:46:34.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
31122026-10-29T02:46:34.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31132026-10-29T02:46:34.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
31142026-10-29T02:46:34.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
31152026-10-29T02:46:34.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
31162026-10-29T02:46:34.415ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
31172026-10-29T02:46:34.415ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
31182026-10-29T02:46:34.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 689.019041ms iteration = 25 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
31192026-10-29T02:46:34.483ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
31202026-10-29T02:46:34.483ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
31212026-10-29T02:46:34.483ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31222026-10-29T02:46:34.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31232026-10-29T02:46:34.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31242026-10-29T02:46:34.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31252026-10-29T02:46:34.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262026-10-29T02:46:34.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
31272026-10-29T02:46:34.492ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
31282026-10-29T02:46:34.493ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "82178d67-8431-4352-86be-0c9805e42583", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
31292026-10-29T02:46:34.493ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
31302026-10-29T02:46:34.493ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = Dns step id = Ensure
31312026-10-29T02:46:34.493ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
31322026-10-29T02:46:34.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31332026-10-29T02:46:34.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31342026-10-29T02:46:34.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31352026-10-29T02:46:34.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31362026-10-29T02:46:34.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372026-10-29T02:46:34.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31382026-10-29T02:46:34.500ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
31392026-10-29T02:46:34.500ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
31402026-10-29T02:46:34.500ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
31412026-10-29T02:46:34.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31422026-10-29T02:46:34.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31432026-10-29T02:46:34.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442026-10-29T02:46:34.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31452026-10-29T02:46:34.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31462026-10-29T02:46:34.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31472026-10-29T02:46:34.509ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
31482026-10-29T02:46:34.509ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31492026-10-29T02:46:34.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31502026-10-29T02:46:34.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31512026-10-29T02:46:34.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522026-10-29T02:46:34.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31532026-10-29T02:46:34.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31542026-10-29T02:46:34.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31552026-10-29T02:46:34.517ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
31562026-10-29T02:46:34.517ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
31572026-10-29T02:46:34.517ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
31582026-10-29T02:46:34.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31592026-10-29T02:46:34.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31602026-10-29T02:46:34.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31612026-10-29T02:46:34.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31622026-10-29T02:46:34.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31632026-10-29T02:46:34.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31642026-10-29T02:46:34.525ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
31652026-10-29T02:46:34.525ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
31662026-10-29T02:46:34.525ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
31672026-10-29T02:46:34.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31682026-10-29T02:46:34.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31692026-10-29T02:46:34.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31702026-10-29T02:46:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31712026-10-29T02:46:34.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31722026-10-29T02:46:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31732026-10-29T02:46:34.580ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
31742026-10-29T02:46:34.580ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
31752026-10-29T02:46:34.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31762026-10-29T02:46:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31772026-10-29T02:46:34.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31782026-10-29T02:46:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31792026-10-29T02:46:34.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31802026-10-29T02:46:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31812026-10-29T02:46:34.589ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
31822026-10-29T02:46:34.589ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
31832026-10-29T02:46:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31842026-10-29T02:46:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31852026-10-29T02:46:34.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31862026-10-29T02:46:34.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
31872026-10-29T02:46:34.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31882026-10-29T02:46:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31892026-10-29T02:46:34.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31902026-10-29T02:46:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31912026-10-29T02:46:34.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
31922026-10-29T02:46:34.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
31932026-10-29T02:46:34.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942026-10-29T02:46:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
31952026-10-29T02:46:34.603ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
31962026-10-29T02:46:34.603ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
31972026-10-29T02:46:34.603ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = OmicronZones step id = Cleanup
31982026-10-29T02:46:34.603ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = OmicronZones step id = Cleanup
31992026-10-29T02:46:34.603ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = PhysicalDisks step id = Cleanup
32002026-10-29T02:46:34.603ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = Clickhouse step id = Ensure
32012026-10-29T02:46:34.603ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = Clickhouse step id = Ensure
32022026-10-29T02:46:34.603ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
32032026-10-29T02:46:34.607ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "ea8f481b-1cc5-4a4c-91bc-2ba6f6163c58", "date": "Thu, 29 Oct 2026 02:46:34 GMT"} })
32042026-10-29T02:46:34.607ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = SupportBundles step id = Cleanup
32052026-10-29T02:46:34.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32062026-10-29T02:46:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32072026-10-29T02:46:34.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082026-10-29T02:46:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
32092026-10-29T02:46:34.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32102026-10-29T02:46:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32112026-10-29T02:46:34.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32122026-10-29T02:46:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32132026-10-29T02:46:34.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142026-10-29T02:46:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
32152026-10-29T02:46:34.677ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = OmicronZones step id = Cleanup
32162026-10-29T02:46:34.677ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
32172026-10-29T02:46:34.677ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
32182026-10-29T02:46:34.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32192026-10-29T02:46:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32202026-10-29T02:46:34.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32212026-10-29T02:46:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
32222026-10-29T02:46:34.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32232026-10-29T02:46:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32242026-10-29T02:46:34.727ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
32252026-10-29T02:46:34.727ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
32262026-10-29T02:46:34.727ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = OmicronZones step id = Cleanup
32272026-10-29T02:46:34.727ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
32282026-10-29T02:46:34.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32292026-10-29T02:46:34.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32302026-10-29T02:46:34.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32312026-10-29T02:46:34.731ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
32322026-10-29T02:46:34.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32332026-10-29T02:46:34.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32342026-10-29T02:46:34.832ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
32352026-10-29T02:46:34.832ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = Cockroach step id = Ensure
32362026-10-29T02:46:34.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
32372026-10-29T02:46:34.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
32382026-10-29T02:46:34.840ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
32392026-10-29T02:46:34.840ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 7d10e927-d030-4ad7-ab08-b2330c7c4c47 step component = MgsUpdates step id = Ensure
32402026-10-29T02:46:34.840ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 10 reason = Dependency
32412026-10-29T02:46:34.840ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Dependency
32422026-10-29T02:46:34.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32432026-10-29T02:46:34.840ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32442026-10-29T02:46:34.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.11426714s iteration = 10 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":2689,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":355803985,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":355803925,"secs":0}},"event_index":1,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":355818775,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":19239180,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":19239140,"secs":0}},"event_index":2,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":375077496,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":110256342,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":110256302,"secs":0}},"event_index":3,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":485357328,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3487333,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3487282,"secs":0}},"event_index":4,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":488857410,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":277722363,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":277722333,"secs":0}},"event_index":5,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":766586313,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":110594159,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":110594099,"secs":0}},"event_index":6,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":877188222,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":6500,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":6470,"secs":0}},"event_index":7,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":877213352,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2160,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2120,"secs":0}},"event_index":8,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":877218162,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3131,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3091,"secs":0}},"event_index":9,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":877222942,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":1960,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":1920,"secs":0}},"event_index":10,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":877227122,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3616135,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":3616085,"secs":0}},"event_index":11,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":880844288,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":70228389,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":70228349,"secs":0}},"event_index":12,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":951079577,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":49738254,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":49738204,"secs":0}},"event_index":13,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":834552,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":105161766,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":105161716,"secs":0}},"event_index":14,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":106011268,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":7853443,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":7853383,"secs":0}},"event_index":15,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":113879521,"secs":1}},{"data":{"attempt_elapsed":{"nanos":8050,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":8000,"secs":0}},"event_index":16,"execution_id":"7d10e927-d030-4ad7-ab08-b2330c7c4c47","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":113901902,"secs":1}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
32452026-10-29T02:46:34.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32462026-10-29T02:46:34.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
32472026-10-29T02:46:34.843ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32482026-10-29T02:46:34.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32492026-10-29T02:46:34.846ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
32502026-10-29T02:46:34.846ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32512026-10-29T02:46:34.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
32522026-10-29T02:46:34.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32532026-10-29T02:46:34.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32542026-10-29T02:46:34.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32552026-10-29T02:46:34.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32562026-10-29T02:46:34.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32572026-10-29T02:46:34.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32582026-10-29T02:46:34.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32592026-10-29T02:46:34.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32602026-10-29T02:46:34.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32612026-10-29T02:46:34.900ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
32622026-10-29T02:46:34.900ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 60.16098ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
32632026-10-29T02:46:34.930ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(6dd4d226-8a31-450a-9cfd-dff1b7e05b0a, 0), (03916cbc-ab4c-4d59-b35d-bbcfd602edc2, 0), (dd5206a3-4950-4298-b192-e23e6c5b5181, 0), (9a208e82-0cd9-43d2-8b54-25502e463b14, 0)] collection_id = 6dd4d226-8a31-450a-9cfd-dff1b7e05b0a
32642026-10-29T02:46:34.930ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32652026-10-29T02:46:34.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
32662026-10-29T02:46:35.051ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 6dd4d226-8a31-450a-9cfd-dff1b7e05b0a file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 0 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 0 nconfig_reconcilers = 0 ndatasets = 0 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 0 nhost_phase1_active_slots = 0 nhost_phase1_flash_hashes = 0 ninternal_dns = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_external_ips = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 npower_shelf_psus = 0 nrot_pages = 0 nrots = 0 nsled_agents = 0 nsps = 0 nsvcs_enabled_not_online = 0 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
32672026-10-29T02:46:35.051ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32682026-10-29T02:46:35.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
32692026-10-29T02:46:35.054ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(03916cbc-ab4c-4d59-b35d-bbcfd602edc2, 0), (dd5206a3-4950-4298-b192-e23e6c5b5181, 0), (9a208e82-0cd9-43d2-8b54-25502e463b14, 0)]
32702026-10-29T02:46:35.054ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 732618987 } })
32712026-10-29T02:46:35.055ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 733745640 } })
32722026-10-29T02:46:35.056ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
32732026-10-29T02:46:35.056ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
32742026-10-29T02:46:35.056ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
32752026-10-29T02:46:35.056ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12863025-b953-46bf-bc87-be1364edd4ca", "content-length": "50", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32762026-10-29T02:46:35.056ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
32772026-10-29T02:46:35.057ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "78245371-8c4d-448f-9c0c-c60f5d3f0ef0", "content-length": "681", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32782026-10-29T02:46:35.057ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
32792026-10-29T02:46:35.057ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f482e16c-a09a-43e7-9b0b-2d19a40aee96", "content-length": "734", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32802026-10-29T02:46:35.057ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
32812026-10-29T02:46:35.058ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2b4b4f5-d36d-4510-9560-712b0c501fb4", "content-length": "111", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32822026-10-29T02:46:35.058ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
32832026-10-29T02:46:35.058ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aeefb7de-02c7-4eb5-bcc4-737d184b5da1", "content-length": "111", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32842026-10-29T02:46:35.059ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
32852026-10-29T02:46:35.059ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a651349f-a195-4896-aafc-15d5bf88cc03", "content-length": "163", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32862026-10-29T02:46:35.059ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
32872026-10-29T02:46:35.059ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "691b31d7-d398-41cd-bebc-c222ba0bfc75", "content-length": "163", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32882026-10-29T02:46:35.059ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
32892026-10-29T02:46:35.060ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e4dc1b4-9e3b-425a-8004-0bef29824f8b", "content-length": "166", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32902026-10-29T02:46:35.060ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
32912026-10-29T02:46:35.060ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3210491d-3bcd-4fd7-aee8-10f1c8fbf90c", "content-length": "166", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32922026-10-29T02:46:35.060ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
32932026-10-29T02:46:35.060ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "876ea8a0-6843-407c-910d-b93a5d5d3458", "content-length": "702", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32942026-10-29T02:46:35.060ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
32952026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dd9fb64-56b7-4cc0-9e6b-ddc35626d915", "content-length": "727", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32962026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
32972026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5bfcb1e-1763-46a4-9a26-a369a6077472", "content-length": "729", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
32982026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
32992026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc1dc90f-0163-41b6-bea3-6d64aac812f0", "content-length": "728", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33002026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
33012026-10-29T02:46:35.061ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "408d7d49-2e63-450e-938d-c1f4be17a6ec", "content-length": "722", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33022026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
33032026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "b77005f6-80ed-405f-a15c-3e71a887220b", "content-length": "10", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33042026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
33052026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d64031-06b5-42df-b370-0f72030db698", "content-length": "144", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33062026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
33072026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "787c952e-af7e-4aee-b4b8-0654b837fe7a", "content-length": "147", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33082026-10-29T02:46:35.062ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
33092026-10-29T02:46:35.063ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "34a1fdbc-a65a-44f8-9a51-a482cdb62edc", "content-length": "109", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33102026-10-29T02:46:35.063ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
33112026-10-29T02:46:35.063ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "203d7103-fb57-4c5d-a3e7-e5522bfa411d", "content-length": "109", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33122026-10-29T02:46:35.063ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
33132026-10-29T02:46:35.064ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bb20c45-2eac-4f8d-8bac-48157d9650a9", "content-length": "163", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33142026-10-29T02:46:35.064ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
33152026-10-29T02:46:35.064ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "72edd63c-a372-4a74-96ee-802159f1ebcb", "content-length": "163", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33162026-10-29T02:46:35.064ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
33172026-10-29T02:46:35.064ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "902775a8-2ea3-4e26-af9e-b7073b4a6a34", "content-length": "166", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33182026-10-29T02:46:35.064ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
33192026-10-29T02:46:35.065ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a765b9a-16b3-4b7e-8672-cbb4b3850094", "content-length": "166", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33202026-10-29T02:46:35.065ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
33212026-10-29T02:46:35.065ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4d6ab6c-cc9b-4341-a7ad-61357d738fc6", "content-length": "702", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33222026-10-29T02:46:35.065ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
33232026-10-29T02:46:35.065ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2fe52cb-7395-4af3-8816-5b46396ab7e1", "content-length": "727", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33242026-10-29T02:46:35.065ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
33252026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7be1225f-5b16-483c-9c8b-584f7c06f396", "content-length": "729", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33262026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
33272026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd635d1b-0ea1-431c-b677-7e0e3d7f41a4", "content-length": "728", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33282026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
33292026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "16b4bde0-99c5-4651-8663-4185617441ea", "content-length": "722", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33302026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
33312026-10-29T02:46:35.066ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bac937c-45dc-4518-aaa1-2557d364f818", "content-length": "10", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33322026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
33332026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed428af1-4522-46dc-98d0-6794b4ad805f", "content-length": "144", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33342026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
33352026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd1bc761-aebd-4a74-bde3-ba469e77e5b2", "content-length": "147", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33362026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
33372026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5213310c-b819-4cb1-af0e-8d0a2c61c151", "content-length": "109", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33382026-10-29T02:46:35.067ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
33392026-10-29T02:46:35.068ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d392e72-68e6-4abb-88ac-1de5d729fcb1", "content-length": "109", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33402026-10-29T02:46:35.068ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
33412026-10-29T02:46:35.068ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c44e7b4b-f3dd-49ed-bbcc-19a1db1f1585", "content-length": "163", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33422026-10-29T02:46:35.068ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
33432026-10-29T02:46:35.069ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac8d8f73-374e-4998-b85e-7eefbb12f9bf", "content-length": "163", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33442026-10-29T02:46:35.069ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
33452026-10-29T02:46:35.069ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "19175844-0bad-458e-a9f8-3e07cd8896c3", "content-length": "166", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33462026-10-29T02:46:35.069ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
33472026-10-29T02:46:35.070ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d6a244e-fcdc-4f92-9d3f-d829c7cedc75", "content-length": "166", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33482026-10-29T02:46:35.070ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
33492026-10-29T02:46:35.070ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a25665b-d19d-4e15-b187-9f058c175ec2", "content-length": "702", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33502026-10-29T02:46:35.070ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
33512026-10-29T02:46:35.070ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "072df67b-c19c-4399-8c72-6af2b49addd0", "content-length": "727", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33522026-10-29T02:46:35.070ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
33532026-10-29T02:46:35.071ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e54cfafe-bd5b-4d74-8446-51c629a3177f", "content-length": "729", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33542026-10-29T02:46:35.071ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
33552026-10-29T02:46:35.071ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "443cdf24-98d7-4862-80a1-2ce85ea13482", "content-length": "728", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33562026-10-29T02:46:35.071ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33572026-10-29T02:46:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
33582026-10-29T02:46:35.073ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33592026-10-29T02:46:35.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
33602026-10-29T02:46:35.075ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33612026-10-29T02:46:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
33622026-10-29T02:46:35.077ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632026-10-29T02:46:35.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
33642026-10-29T02:46:35.080ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33652026-10-29T02:46:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
33662026-10-29T02:46:35.083ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
33672026-10-29T02:46:35.083ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
33682026-10-29T02:46:35.152ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4bb5179-db46-449b-a250-61fbe3ef31f2", "content-length": "93657", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33692026-10-29T02:46:35.153ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
33702026-10-29T02:46:35.153ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
33712026-10-29T02:46:35.153ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
33722026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
33732026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
33742026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
33752026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
33762026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
33772026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "898b2d39-9ca1-4873-b1b7-75bb046cf249", "content-length": "64", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33782026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ee91358-0731-44c0-af0d-b8c4cc967fb6", "content-length": "64", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33792026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
33802026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
33812026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70713d72-de36-41ff-bb77-91ec9bedb354", "content-length": "64", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33822026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7aefdfc-cb0a-4b1d-b5cb-702cdc9316ea", "content-length": "64", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33832026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
33842026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2472ee-afbe-4d81-b6a3-429e44bb8d47", "content-length": "64", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33852026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
33862026-10-29T02:46:35.153ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
33872026-10-29T02:46:35.159ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba520b7b-edb1-4a0c-b05d-80cdec606484", "content-length": "412530", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33882026-10-29T02:46:35.160ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ab23b6d-0206-4616-872f-e8da0835d44f", "content-length": "411165", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33892026-10-29T02:46:35.161ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "aeb8c752-39b9-4225-ac87-5a1bba2097e9", "content-length": "413047", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33902026-10-29T02:46:35.162ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "1360b1bb-b2d2-4112-bbfd-354ba42be356", "content-length": "423366", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33912026-10-29T02:46:35.162ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eadf9a8-2bbf-4333-a4b5-fe78d94ddfb1", "content-length": "410482", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
33922026-10-29T02:46:35.166ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
33932026-10-29T02:46:35.166ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
33942026-10-29T02:46:35.166ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
33952026-10-29T02:46:35.166ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
33962026-10-29T02:46:35.166ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
33972026-10-29T02:46:35.166ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
33982026-10-29T02:46:35.166ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
33992026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffdfd195-16f6-400c-9c39-d22aa3b86fee", "content-length": "259", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
34002026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
34012026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
34022026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
34032026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
34042026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
34052026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
34062026-10-29T02:46:35.170ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
34072026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d60e7b5-9d1e-448c-af2e-f125d3c7a412", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
34082026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e4952ca-cea8-45a4-8bec-2d5b96b95ac7", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
34092026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cb50dc1-168a-4ef3-8d19-8dcd7de251b5", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:46:35 GMT"} })
34102026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
34112026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
34122026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
34132026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
34142026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
34152026-10-29T02:46:35.171ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34162026-10-29T02:46:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
34172026-10-29T02:46:35.174ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182026-10-29T02:46:35.178ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
34192026-10-29T02:46:35.178ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34202026-10-29T02:46:35.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
34212026-10-29T02:46:35.514ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 file = nexus/db-queries/src/db/datastore/inventory.rs:2241
34222026-10-29T02:46:35.514ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 time_started = 2026-10-29 02:46:35.056377 UTC
34232026-10-29T02:46:35.514ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 44 reason = Dependency
34242026-10-29T02:46:35.514ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
34252026-10-29T02:46:35.514ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 674.154083ms iteration = 10 status = {"collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","time_done":"2026-10-29 02:46:35.171818 UTC","time_started":"2026-10-29 02:46:35.056377 UTC"}
34262026-10-29T02:46:35.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
34272026-10-29T02:46:35.517ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282026-10-29T02:46:35.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
34292026-10-29T02:46:35.521ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
34302026-10-29T02:46:35.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
34312026-10-29T02:46:35.524ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
34322026-10-29T02:46:35.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
34332026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 82.040595ms iteration = 44 status = {"Loaded":{"collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","time_loaded":"2026-10-29T02:46:35.514608945Z","time_started":"2026-10-29T02:46:35.056377Z"}}
34342026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Dependency
34352026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 18 reason = Dependency
34362026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 26 reason = Dependency
34372026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 24 reason = Dependency
34382026-10-29T02:46:35.596ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
34392026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
34402026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34412026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34422026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 17.73\u{b5}s iteration = 24 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
34432026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 24 reason = Dependency
34442026-10-29T02:46:35.596ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
34452026-10-29T02:46:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
34462026-10-29T02:46:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34472026-10-29T02:46:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34482026-10-29T02:46:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
34492026-10-29T02:46:35.599ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502026-10-29T02:46:35.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34512026-10-29T02:46:35.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522026-10-29T02:46:35.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34542026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34552026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
34562026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
34572026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
34582026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
34592026-10-29T02:46:35.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34602026-10-29T02:46:35.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34612026-10-29T02:46:35.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34622026-10-29T02:46:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
34632026-10-29T02:46:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
34642026-10-29T02:46:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34652026-10-29T02:46:35.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662026-10-29T02:46:35.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34672026-10-29T02:46:35.607ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682026-10-29T02:46:35.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34692026-10-29T02:46:35.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34702026-10-29T02:46:35.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712026-10-29T02:46:35.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34722026-10-29T02:46:35.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34732026-10-29T02:46:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34742026-10-29T02:46:35.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
34752026-10-29T02:46:35.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
34762026-10-29T02:46:35.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
34772026-10-29T02:46:35.612ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
34782026-10-29T02:46:35.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
34792026-10-29T02:46:35.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
34802026-10-29T02:46:35.612ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34812026-10-29T02:46:35.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34822026-10-29T02:46:35.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34832026-10-29T02:46:35.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34842026-10-29T02:46:35.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34852026-10-29T02:46:35.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
34862026-10-29T02:46:35.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
34872026-10-29T02:46:35.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882026-10-29T02:46:35.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34892026-10-29T02:46:35.617ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
34902026-10-29T02:46:35.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
34912026-10-29T02:46:35.618ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34922026-10-29T02:46:35.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34932026-10-29T02:46:35.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34942026-10-29T02:46:35.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34952026-10-29T02:46:35.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34962026-10-29T02:46:35.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
34972026-10-29T02:46:35.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
34982026-10-29T02:46:35.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
34992026-10-29T02:46:35.621ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35002026-10-29T02:46:35.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35012026-10-29T02:46:35.621ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35022026-10-29T02:46:35.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35032026-10-29T02:46:35.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35042026-10-29T02:46:35.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35052026-10-29T02:46:35.624ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062026-10-29T02:46:35.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35072026-10-29T02:46:35.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35082026-10-29T02:46:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35092026-10-29T02:46:35.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35102026-10-29T02:46:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
35112026-10-29T02:46:35.628ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35122026-10-29T02:46:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35132026-10-29T02:46:35.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
35142026-10-29T02:46:35.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35152026-10-29T02:46:35.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35162026-10-29T02:46:35.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35172026-10-29T02:46:35.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35182026-10-29T02:46:35.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35192026-10-29T02:46:35.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35202026-10-29T02:46:35.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35212026-10-29T02:46:35.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35222026-10-29T02:46:35.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35232026-10-29T02:46:35.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35242026-10-29T02:46:35.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35252026-10-29T02:46:35.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35262026-10-29T02:46:35.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35272026-10-29T02:46:35.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35282026-10-29T02:46:35.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
35292026-10-29T02:46:35.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35302026-10-29T02:46:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35312026-10-29T02:46:35.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35322026-10-29T02:46:35.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35332026-10-29T02:46:35.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35342026-10-29T02:46:35.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35352026-10-29T02:46:35.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35362026-10-29T02:46:35.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35372026-10-29T02:46:35.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35382026-10-29T02:46:35.649ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
35392026-10-29T02:46:35.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35402026-10-29T02:46:35.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35412026-10-29T02:46:35.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
35422026-10-29T02:46:35.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35432026-10-29T02:46:35.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35442026-10-29T02:46:35.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35452026-10-29T02:46:35.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35462026-10-29T02:46:35.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35472026-10-29T02:46:35.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35482026-10-29T02:46:35.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492026-10-29T02:46:35.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35502026-10-29T02:46:35.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35512026-10-29T02:46:35.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35522026-10-29T02:46:35.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35532026-10-29T02:46:35.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35542026-10-29T02:46:35.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35552026-10-29T02:46:35.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
35562026-10-29T02:46:35.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35572026-10-29T02:46:35.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
35582026-10-29T02:46:35.674ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
35592026-10-29T02:46:35.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35602026-10-29T02:46:35.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35612026-10-29T02:46:35.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35622026-10-29T02:46:35.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35632026-10-29T02:46:35.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642026-10-29T02:46:35.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652026-10-29T02:46:35.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35662026-10-29T02:46:35.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35672026-10-29T02:46:35.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35682026-10-29T02:46:35.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35692026-10-29T02:46:35.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35702026-10-29T02:46:35.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35712026-10-29T02:46:35.699ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35722026-10-29T02:46:35.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35732026-10-29T02:46:35.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742026-10-29T02:46:35.701ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752026-10-29T02:46:35.703ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.887281ms iteration = 32 status = {"disks_added":0,"errors":[]}
35762026-10-29T02:46:35.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35772026-10-29T02:46:35.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35782026-10-29T02:46:35.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35792026-10-29T02:46:35.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
35802026-10-29T02:46:35.706ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35812026-10-29T02:46:35.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35822026-10-29T02:46:35.708ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
35832026-10-29T02:46:35.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 111.554958ms iteration = 18 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
35842026-10-29T02:46:35.708ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 16 reason = Dependency
35852026-10-29T02:46:35.708ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
35862026-10-29T02:46:35.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
35872026-10-29T02:46:35.710ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35882026-10-29T02:46:35.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35892026-10-29T02:46:35.712ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
35902026-10-29T02:46:35.712ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 4.699347ms iteration = 16 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
35912026-10-29T02:46:35.712ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 25 reason = Dependency
35922026-10-29T02:46:35.712ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
35932026-10-29T02:46:35.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
35942026-10-29T02:46:35.713ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35952026-10-29T02:46:35.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
35962026-10-29T02:46:35.717ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
35972026-10-29T02:46:35.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
35982026-10-29T02:46:35.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
35992026-10-29T02:46:35.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36002026-10-29T02:46:35.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36012026-10-29T02:46:35.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
36022026-10-29T02:46:35.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36032026-10-29T02:46:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36042026-10-29T02:46:35.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36052026-10-29T02:46:35.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36062026-10-29T02:46:35.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072026-10-29T02:46:35.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
36082026-10-29T02:46:35.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36092026-10-29T02:46:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36102026-10-29T02:46:35.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36112026-10-29T02:46:35.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36122026-10-29T02:46:35.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36132026-10-29T02:46:35.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
36142026-10-29T02:46:35.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36152026-10-29T02:46:35.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36162026-10-29T02:46:35.787ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
36172026-10-29T02:46:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
36182026-10-29T02:46:35.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36192026-10-29T02:46:35.789ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202026-10-29T02:46:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36212026-10-29T02:46:35.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36222026-10-29T02:46:35.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36232026-10-29T02:46:35.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
36242026-10-29T02:46:35.792ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
36252026-10-29T02:46:35.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
36262026-10-29T02:46:35.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36272026-10-29T02:46:35.795ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
36282026-10-29T02:46:35.795ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
36292026-10-29T02:46:35.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
36302026-10-29T02:46:35.797ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36312026-10-29T02:46:35.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
36322026-10-29T02:46:35.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36332026-10-29T02:46:35.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
36342026-10-29T02:46:35.800ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
36352026-10-29T02:46:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
36362026-10-29T02:46:35.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36372026-10-29T02:46:35.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36382026-10-29T02:46:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36392026-10-29T02:46:35.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36402026-10-29T02:46:35.805ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
36412026-10-29T02:46:35.805ZINFOnexus (BackgroundTasks): building sitrep 0ece2a01-6f67-48a3-9a6f-3cfa4200b7e9 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 0ece2a01-6f67-48a3-9a6f-3cfa4200b7e9 (sitrep)
36422026-10-29T02:46:35.805ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
36432026-10-29T02:46:35.805ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 208.596526ms iteration = 24 status = {"inv_collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:46:35.805239576Z","outcome":"Unchanged","start_time":"2026-10-29T02:46:35.805209446Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
36442026-10-29T02:46:35.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
36452026-10-29T02:46:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36462026-10-29T02:46:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36472026-10-29T02:46:35.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36482026-10-29T02:46:35.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36492026-10-29T02:46:35.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502026-10-29T02:46:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
36512026-10-29T02:46:35.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36522026-10-29T02:46:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36532026-10-29T02:46:35.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36542026-10-29T02:46:35.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36552026-10-29T02:46:35.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562026-10-29T02:46:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
36572026-10-29T02:46:35.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36582026-10-29T02:46:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36592026-10-29T02:46:35.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36602026-10-29T02:46:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36612026-10-29T02:46:35.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36622026-10-29T02:46:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
36632026-10-29T02:46:35.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36642026-10-29T02:46:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36652026-10-29T02:46:35.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36662026-10-29T02:46:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36672026-10-29T02:46:35.846ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
36682026-10-29T02:46:35.846ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 133.799252ms iteration = 25 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
36692026-10-29T02:46:35.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702026-10-29T02:46:35.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
36712026-10-29T02:46:35.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36722026-10-29T02:46:35.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36732026-10-29T02:46:35.853ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
36742026-10-29T02:46:35.853ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
36752026-10-29T02:46:35.853ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = e9ede117-901a-4ea3-96cd-1392545d5593 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
36762026-10-29T02:46:35.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36772026-10-29T02:46:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36782026-10-29T02:46:35.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792026-10-29T02:46:35.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
36802026-10-29T02:46:35.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
36812026-10-29T02:46:35.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
36822026-10-29T02:46:35.866ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
36832026-10-29T02:46:35.866ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
36842026-10-29T02:46:35.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 270.080133ms iteration = 26 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
36852026-10-29T02:46:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 98 reason = Timeout
36862026-10-29T02:46:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
36872026-10-29T02:46:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
36882026-10-29T02:46:38.727ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36892026-10-29T02:46:38.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
36902026-10-29T02:46:38.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
36912026-10-29T02:46:38.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
36922026-10-29T02:46:38.733ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
36932026-10-29T02:46:38.733ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.392593ms iteration = 98 status = {"config_updated":false}
36942026-10-29T02:46:40.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 138 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 3386dbd1-25a2-42a6-9fc9-ff82af45a92a response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
36952026-10-29T02:46:43.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 99 reason = Timeout
36962026-10-29T02:46:43.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
36972026-10-29T02:46:43.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
36982026-10-29T02:46:43.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
36992026-10-29T02:46:43.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37002026-10-29T02:46:43.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37012026-10-29T02:46:43.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
37022026-10-29T02:46:43.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37032026-10-29T02:46:43.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37042026-10-29T02:46:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37052026-10-29T02:46:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062026-10-29T02:46:43.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37072026-10-29T02:46:43.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37082026-10-29T02:46:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
37092026-10-29T02:46:43.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
37102026-10-29T02:46:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37112026-10-29T02:46:43.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37122026-10-29T02:46:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
37132026-10-29T02:46:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37142026-10-29T02:46:43.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
37152026-10-29T02:46:43.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.893074ms iteration = 99 status = {"config_updated":false}
37162026-10-29T02:46:43.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37172026-10-29T02:46:43.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37182026-10-29T02:46:43.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37192026-10-29T02:46:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
37202026-10-29T02:46:43.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37212026-10-29T02:46:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37222026-10-29T02:46:43.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
37232026-10-29T02:46:43.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.17144ms iteration = 50 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
37242026-10-29T02:46:43.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.690733ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37252026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 100 reason = Timeout
37262026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
37272026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 45 reason = Timeout
37282026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
37292026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 34 reason = Timeout
37302026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 36 reason = Timeout
37312026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
37322026-10-29T02:46:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
37332026-10-29T02:46:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
37342026-10-29T02:46:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
37352026-10-29T02:46:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
37362026-10-29T02:46:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
37372026-10-29T02:46:48.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382026-10-29T02:46:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392026-10-29T02:46:48.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37402026-10-29T02:46:48.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37412026-10-29T02:46:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
37422026-10-29T02:46:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
37432026-10-29T02:46:48.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
37442026-10-29T02:46:48.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
37452026-10-29T02:46:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
37462026-10-29T02:46:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
37472026-10-29T02:46:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
37482026-10-29T02:46:48.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
37492026-10-29T02:46:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
37502026-10-29T02:46:48.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
37512026-10-29T02:46:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
37522026-10-29T02:46:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
37532026-10-29T02:46:48.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
37542026-10-29T02:46:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.694621ms iteration = 100 status = {"config_updated":false}
37552026-10-29T02:46:48.737ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
37562026-10-29T02:46:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 10.406366ms iteration = 36 status = {"Loaded":{"time_loaded":"2026-10-29T02:46:48.726607987Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
37572026-10-29T02:46:48.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
37582026-10-29T02:46:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 11.017869ms iteration = 34 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
37592026-10-29T02:46:48.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 original_time_started = 2026-10-29 02:46:35.056377 UTC
37602026-10-29T02:46:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 11.230794ms iteration = 45 status = {"Loaded":{"collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","time_loaded":"2026-10-29T02:46:48.726542346Z","time_started":"2026-10-29T02:46:35.056377Z"}}
37612026-10-29T02:46:49.188ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = e62c6b75-f1a0-4ca7-9fe4-1f8a3a6aa652 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
37622026-10-29T02:46:49.188ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = e62c6b75-f1a0-4ca7-9fe4-1f8a3a6aa652 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
37632026-10-29T02:46:49.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = e62c6b75-f1a0-4ca7-9fe4-1f8a3a6aa652 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
37642026-10-29T02:46:49.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = e62c6b75-f1a0-4ca7-9fe4-1f8a3a6aa652 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
37652026-10-29T02:46:49.192ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 03b23bc5-173b-4401-925e-1ce73339e3b0 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
37662026-10-29T02:46:49.192ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 03b23bc5-173b-4401-925e-1ce73339e3b0 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
37672026-10-29T02:46:49.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 03b23bc5-173b-4401-925e-1ce73339e3b0 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
37682026-10-29T02:46:49.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = 03b23bc5-173b-4401-925e-1ce73339e3b0 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
37692026-10-29T02:46:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 126 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = c315b87e-6a94-461e-a603-af4d1aff547d response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
37702026-10-29T02:46:53.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 101 reason = Timeout
37712026-10-29T02:46:53.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
37722026-10-29T02:46:53.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
37732026-10-29T02:46:53.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
37742026-10-29T02:46:53.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37752026-10-29T02:46:53.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37762026-10-29T02:46:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
37772026-10-29T02:46:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37782026-10-29T02:46:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37792026-10-29T02:46:53.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37802026-10-29T02:46:53.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37812026-10-29T02:46:53.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37822026-10-29T02:46:53.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37832026-10-29T02:46:53.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.901531ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37842026-10-29T02:46:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
37852026-10-29T02:46:53.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
37862026-10-29T02:46:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
37872026-10-29T02:46:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37882026-10-29T02:46:53.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892026-10-29T02:46:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37902026-10-29T02:46:53.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
37912026-10-29T02:46:53.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.813222ms iteration = 101 status = {"config_updated":false}
37922026-10-29T02:46:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37932026-10-29T02:46:53.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37942026-10-29T02:46:53.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37952026-10-29T02:46:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
37962026-10-29T02:46:53.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37972026-10-29T02:46:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
37982026-10-29T02:46:53.763ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
37992026-10-29T02:46:53.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.996779ms iteration = 51 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
38002026-10-29T02:46:58.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 102 reason = Timeout
38012026-10-29T02:46:58.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
38022026-10-29T02:46:58.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
38032026-10-29T02:46:58.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042026-10-29T02:46:58.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
38052026-10-29T02:46:58.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
38062026-10-29T02:46:58.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
38072026-10-29T02:46:58.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
38082026-10-29T02:46:58.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.464366ms iteration = 102 status = {"config_updated":false}
38092026-10-29T02:47:00.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 166 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = de91ec93-4974-4ca9-a7ca-139c44875c0f response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
38102026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 103 reason = Timeout
38112026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
38122026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
38132026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
38142026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38152026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38162026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
38172026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38182026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 18 reason = Timeout
38192026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
38202026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
38212026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
38222026-10-29T02:47:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38232026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38242026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 46 reason = Timeout
38252026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
38262026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
38272026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38282026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
38292026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38302026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
38312026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 37 reason = Timeout
38322026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38332026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
38342026-10-29T02:47:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 35 reason = Timeout
38352026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
38362026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
38372026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38382026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 18 reason = Timeout
38392026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
38402026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
38412026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38422026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
38432026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
38442026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38452026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38462026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
38472026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38482026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 18 reason = Timeout
38492026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
38502026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
38512026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38522026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38532026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
38542026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
38552026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38562026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
38572026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38582026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38592026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38602026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
38612026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
38622026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
38632026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
38642026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38652026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
38662026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38672026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
38682026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38692026-10-29T02:47:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38702026-10-29T02:47:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 405811887 } })
38712026-10-29T02:47:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 405851898 } })
38722026-10-29T02:47:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 405861078 } })
38732026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
38742026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
38752026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d79df11c-3bff-4ad9-bb38-3ee321ea5808", "content-length": "50", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
38762026-10-29T02:47:03.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
38772026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.41081ms iteration = 18 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
38782026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
38792026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12c6439c-773e-4366-8bf6-13cf1b48bb83", "content-length": "50", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
38802026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38812026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb2a4d29-85d6-465f-84e7-ecc4254b114b", "content-length": "681", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
38822026-10-29T02:47:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
38832026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
38842026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
38852026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
38862026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
38872026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
38882026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
38892026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
38902026-10-29T02:47:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912026-10-29T02:47:03.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922026-10-29T02:47:03.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38932026-10-29T02:47:03.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942026-10-29T02:47:03.730ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 408749668 } })
38952026-10-29T02:47:03.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38962026-10-29T02:47:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.233758ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
38972026-10-29T02:47:03.731ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
38982026-10-29T02:47:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.406062ms iteration = 18 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
38992026-10-29T02:47:03.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39002026-10-29T02:47:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
39012026-10-29T02:47:03.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
39022026-10-29T02:47:03.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39032026-10-29T02:47:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 5.326321ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
39042026-10-29T02:47:03.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
39052026-10-29T02:47:03.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
39062026-10-29T02:47:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
39072026-10-29T02:47:03.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.046945ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39082026-10-29T02:47:03.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39092026-10-29T02:47:03.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
39102026-10-29T02:47:03.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
39112026-10-29T02:47:03.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
39122026-10-29T02:47:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
39132026-10-29T02:47:03.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.414857ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39142026-10-29T02:47:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39152026-10-29T02:47:03.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39162026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39172026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39182026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39192026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
39202026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
39212026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
39222026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 11.928577ms iteration = 37 status = {"Loaded":{"time_loaded":"2026-10-29T02:47:03.726950690Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
39232026-10-29T02:47:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39242026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
39252026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39262026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
39272026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
39282026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39292026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
39302026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
39312026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
39322026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
39332026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
39342026-10-29T02:47:03.739ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
39352026-10-29T02:47:03.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
39362026-10-29T02:47:03.740ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
39372026-10-29T02:47:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
39382026-10-29T02:47:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
39392026-10-29T02:47:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
39402026-10-29T02:47:03.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39412026-10-29T02:47:03.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39422026-10-29T02:47:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39432026-10-29T02:47:03.742ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
39442026-10-29T02:47:03.742ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
39452026-10-29T02:47:03.743ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "79e66359-d6c8-4971-9b8c-024d05059689", "content-length": "81", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
39462026-10-29T02:47:03.743ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 original_time_started = 2026-10-29 02:46:35.056377 UTC
39472026-10-29T02:47:03.743ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 16.536214ms iteration = 46 status = {"Loaded":{"collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","time_loaded":"2026-10-29T02:47:03.726880678Z","time_started":"2026-10-29T02:46:35.056377Z"}}
39482026-10-29T02:47:03.743ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
39492026-10-29T02:47:03.743ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 16.768428ms iteration = 35 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
39502026-10-29T02:47:03.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39512026-10-29T02:47:03.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
39522026-10-29T02:47:03.744ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532026-10-29T02:47:03.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542026-10-29T02:47:03.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39552026-10-29T02:47:03.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39562026-10-29T02:47:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39572026-10-29T02:47:03.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39582026-10-29T02:47:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39592026-10-29T02:47:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39602026-10-29T02:47:03.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
39612026-10-29T02:47:03.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39622026-10-29T02:47:03.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
39632026-10-29T02:47:03.806ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
39642026-10-29T02:47:03.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.080484ms iteration = 52 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
39652026-10-29T02:47:03.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39662026-10-29T02:47:03.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 113.758714ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
39672026-10-29T02:47:03.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39682026-10-29T02:47:03.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39692026-10-29T02:47:03.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39702026-10-29T02:47:03.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39712026-10-29T02:47:03.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39722026-10-29T02:47:03.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732026-10-29T02:47:03.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 120.498044ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39742026-10-29T02:47:03.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39752026-10-29T02:47:03.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39762026-10-29T02:47:03.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39772026-10-29T02:47:03.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782026-10-29T02:47:03.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39792026-10-29T02:47:03.852ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39802026-10-29T02:47:03.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39812026-10-29T02:47:03.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39822026-10-29T02:47:03.854ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39832026-10-29T02:47:03.854ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39842026-10-29T02:47:03.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39852026-10-29T02:47:03.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39862026-10-29T02:47:03.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
39872026-10-29T02:47:03.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.268606ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39882026-10-29T02:47:03.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892026-10-29T02:47:03.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39902026-10-29T02:47:03.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39912026-10-29T02:47:03.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
39922026-10-29T02:47:03.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39932026-10-29T02:47:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39942026-10-29T02:47:03.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
39952026-10-29T02:47:03.860ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
39962026-10-29T02:47:03.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
39972026-10-29T02:47:03.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39982026-10-29T02:47:03.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39992026-10-29T02:47:03.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40002026-10-29T02:47:03.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40012026-10-29T02:47:03.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40022026-10-29T02:47:03.865ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
40032026-10-29T02:47:03.865ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
40042026-10-29T02:47:03.865ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
40052026-10-29T02:47:03.865ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 138.58804ms iteration = 103 status = {"config_updated":false}
40062026-10-29T02:47:03.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40072026-10-29T02:47:03.865ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ff2fbf-79a3-4064-8e50-83527a8f932e", "content-length": "81", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
40082026-10-29T02:47:03.866ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
40092026-10-29T02:47:03.866ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
40102026-10-29T02:47:03.866ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "e92ba689-f5d9-438d-9347-beed715d9569", "content-length": "81", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
40112026-10-29T02:47:03.866ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
40122026-10-29T02:47:03.866ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 140.028201ms iteration = 18 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
40132026-10-29T02:47:03.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40142026-10-29T02:47:03.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 141.731556ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40152026-10-29T02:47:03.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40162026-10-29T02:47:03.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40172026-10-29T02:47:03.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40182026-10-29T02:47:03.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40192026-10-29T02:47:03.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
40202026-10-29T02:47:03.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.307354ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40212026-10-29T02:47:03.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40222026-10-29T02:47:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40232026-10-29T02:47:03.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40242026-10-29T02:47:03.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
40252026-10-29T02:47:03.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40262026-10-29T02:47:03.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40272026-10-29T02:47:03.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40282026-10-29T02:47:03.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
40292026-10-29T02:47:03.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40302026-10-29T02:47:03.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40312026-10-29T02:47:03.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40322026-10-29T02:47:03.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
40332026-10-29T02:47:03.898ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
40342026-10-29T02:47:03.899ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bafd68ab-b3ea-4950-82eb-5a07b6525c11", "content-length": "691", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
40352026-10-29T02:47:03.899ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
40362026-10-29T02:47:03.899ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
40372026-10-29T02:47:03.899ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
40382026-10-29T02:47:03.899ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 167.683386ms iteration = 18 status = {}
40392026-10-29T02:47:03.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40402026-10-29T02:47:03.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40412026-10-29T02:47:03.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40422026-10-29T02:47:03.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40432026-10-29T02:47:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40442026-10-29T02:47:03.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40452026-10-29T02:47:03.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40462026-10-29T02:47:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40472026-10-29T02:47:03.913ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
40482026-10-29T02:47:03.913ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 187.13131ms iteration = 18 status = {"incomplete_bootstore_configs":[]}
40492026-10-29T02:47:03.917ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.228884ms iteration = 33 status = {"disks_added":0,"errors":[]}
40502026-10-29T02:47:03.935ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40512026-10-29T02:47:03.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40522026-10-29T02:47:03.938ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532026-10-29T02:47:03.938ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40542026-10-29T02:47:03.938ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40552026-10-29T02:47:03.938ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40562026-10-29T02:47:03.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
40572026-10-29T02:47:03.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40582026-10-29T02:47:03.941ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40592026-10-29T02:47:03.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40602026-10-29T02:47:03.944ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
40612026-10-29T02:47:03.944ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 217.567132ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40622026-10-29T02:47:03.946ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40632026-10-29T02:47:03.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40642026-10-29T02:47:03.946ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c888d519-f105-4881-8d43-51232752c829", "content-length": "372", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
40652026-10-29T02:47:03.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40662026-10-29T02:47:03.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40672026-10-29T02:47:03.962ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40682026-10-29T02:47:03.962ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40692026-10-29T02:47:03.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e3176666-e196-4e17-8c91-c8487649664d", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
40702026-10-29T02:47:03.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40712026-10-29T02:47:03.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40722026-10-29T02:47:03.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40732026-10-29T02:47:03.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40742026-10-29T02:47:03.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40752026-10-29T02:47:03.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40762026-10-29T02:47:03.971ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40772026-10-29T02:47:03.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40782026-10-29T02:47:03.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "37103d91-c068-4ead-bcb6-df478e35a991", "date": "Thu, 29 Oct 2026 02:47:03 GMT"} })
40792026-10-29T02:47:03.972ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 245.579984ms iteration = 27 status = {}
40802026-10-29T02:47:03.991ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40812026-10-29T02:47:03.991ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40822026-10-29T02:47:03.991ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 264.512448ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40832026-10-29T02:47:04.187ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = a21f64ef-a9fc-4581-a134-a00756f7dc48 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
40842026-10-29T02:47:04.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = a21f64ef-a9fc-4581-a134-a00756f7dc48 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
40852026-10-29T02:47:04.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = a21f64ef-a9fc-4581-a134-a00756f7dc48 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
40862026-10-29T02:47:04.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = a21f64ef-a9fc-4581-a134-a00756f7dc48 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
40872026-10-29T02:47:04.191ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = c7d46955-d09f-4679-b5fb-06ce5987ec85 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
40882026-10-29T02:47:04.191ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = c7d46955-d09f-4679-b5fb-06ce5987ec85 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
40892026-10-29T02:47:04.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = c7d46955-d09f-4679-b5fb-06ce5987ec85 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
40902026-10-29T02:47:04.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38687 req_id = c7d46955-d09f-4679-b5fb-06ce5987ec85 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
40912026-10-29T02:47:04.578ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
40922026-10-29T02:47:04.578ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
40932026-10-29T02:47:04.578ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST operation_id = cpapi_producers_post uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
40942026-10-29T02:47:04.578ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:1057 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62712
40952026-10-29T02:47:04.578ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62712 req_id = 3f5c90c5-bea7-4ff8-9b40-3c43bd030ef8 uri = /metrics/producers version = 1.0.0
40962026-10-29T02:47:04.578ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62712 req_id = 3f5c90c5-bea7-4ff8-9b40-3c43bd030ef8 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
40972026-10-29T02:47:04.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62712 req_id = 3f5c90c5-bea7-4ff8-9b40-3c43bd030ef8 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
40982026-10-29T02:47:04.643ZINFOnexus: assigned collector to new producer collector_id = 8a46c129-dc41-46f0-b0fe-5dc9b5402b19 file = nexus/src/app/oximeter.rs:78 producer_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7
40992026-10-29T02:47:04.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 64824 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62712 req_id = 3f5c90c5-bea7-4ff8-9b40-3c43bd030ef8 response_code = 201 uri = /metrics/producers
41002026-10-29T02:47:04.643ZDEBGnexus (producer-registration-task): client response operation_id = cpapi_producers_post result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3f5c90c5-bea7-4ff8-9b40-3c43bd030ef8", "content-length": "41", "date": "Thu, 29 Oct 2026 02:47:04 GMT"} })
41012026-10-29T02:47:04.643ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
41022026-10-29T02:47:08.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 104 reason = Timeout
41032026-10-29T02:47:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41042026-10-29T02:47:08.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41052026-10-29T02:47:08.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062026-10-29T02:47:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
41072026-10-29T02:47:08.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41082026-10-29T02:47:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41092026-10-29T02:47:08.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
41102026-10-29T02:47:08.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.975175ms iteration = 104 status = {"config_updated":false}
41112026-10-29T02:47:10.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 236 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 46a7f361-d98d-454c-b056-b6b653b78bf5 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
41122026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 105 reason = Timeout
41132026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41142026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
41152026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
41162026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41172026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41182026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41192026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
41202026-10-29T02:47:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41212026-10-29T02:47:13.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41222026-10-29T02:47:13.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41232026-10-29T02:47:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
41242026-10-29T02:47:13.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41252026-10-29T02:47:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41262026-10-29T02:47:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41272026-10-29T02:47:13.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41282026-10-29T02:47:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
41292026-10-29T02:47:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41302026-10-29T02:47:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
41312026-10-29T02:47:13.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
41322026-10-29T02:47:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.391556ms iteration = 105 status = {"config_updated":false}
41332026-10-29T02:47:13.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342026-10-29T02:47:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
41352026-10-29T02:47:13.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41362026-10-29T02:47:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
41372026-10-29T02:47:13.763ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
41382026-10-29T02:47:13.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.52268ms iteration = 53 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
41392026-10-29T02:47:13.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41402026-10-29T02:47:13.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41412026-10-29T02:47:13.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.447151ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41422026-10-29T02:47:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 106 reason = Timeout
41432026-10-29T02:47:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41442026-10-29T02:47:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 47 reason = Timeout
41452026-10-29T02:47:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
41462026-10-29T02:47:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 38 reason = Timeout
41472026-10-29T02:47:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
41482026-10-29T02:47:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41492026-10-29T02:47:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
41502026-10-29T02:47:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
41512026-10-29T02:47:18.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 36 reason = Timeout
41522026-10-29T02:47:18.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
41532026-10-29T02:47:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
41542026-10-29T02:47:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41552026-10-29T02:47:18.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562026-10-29T02:47:18.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41572026-10-29T02:47:18.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41582026-10-29T02:47:18.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
41592026-10-29T02:47:18.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
41602026-10-29T02:47:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
41612026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
41622026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41632026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
41642026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
41652026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
41662026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
41672026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
41682026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 8.874234ms iteration = 38 status = {"Loaded":{"time_loaded":"2026-10-29T02:47:18.726883932Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
41692026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41702026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
41712026-10-29T02:47:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
41722026-10-29T02:47:18.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 original_time_started = 2026-10-29 02:46:35.056377 UTC
41732026-10-29T02:47:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.6198ms iteration = 47 status = {"Loaded":{"collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","time_loaded":"2026-10-29T02:47:18.726820611Z","time_started":"2026-10-29T02:46:35.056377Z"}}
41742026-10-29T02:47:18.738ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
41752026-10-29T02:47:18.738ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.518199ms iteration = 36 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
41762026-10-29T02:47:18.738ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
41772026-10-29T02:47:18.738ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 11.722034ms iteration = 106 status = {"config_updated":false}
41782026-10-29T02:47:20.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 131 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = e9b4655c-681f-4966-82cb-3fbbda99b2d4 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
41792026-10-29T02:47:23.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 107 reason = Timeout
41802026-10-29T02:47:23.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41812026-10-29T02:47:23.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
41822026-10-29T02:47:23.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41832026-10-29T02:47:23.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
41842026-10-29T02:47:23.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41852026-10-29T02:47:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41862026-10-29T02:47:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
41872026-10-29T02:47:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41882026-10-29T02:47:23.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892026-10-29T02:47:23.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41902026-10-29T02:47:23.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912026-10-29T02:47:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41922026-10-29T02:47:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.399992ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41932026-10-29T02:47:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
41942026-10-29T02:47:23.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
41952026-10-29T02:47:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
41962026-10-29T02:47:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41972026-10-29T02:47:23.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982026-10-29T02:47:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
41992026-10-29T02:47:23.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42002026-10-29T02:47:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
42012026-10-29T02:47:23.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
42022026-10-29T02:47:23.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.507477ms iteration = 107 status = {"config_updated":false}
42032026-10-29T02:47:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42042026-10-29T02:47:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
42052026-10-29T02:47:23.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42062026-10-29T02:47:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
42072026-10-29T02:47:23.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
42082026-10-29T02:47:23.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.032976ms iteration = 54 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
42092026-10-29T02:47:28.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 108 reason = Timeout
42102026-10-29T02:47:28.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
42112026-10-29T02:47:28.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
42122026-10-29T02:47:28.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132026-10-29T02:47:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
42142026-10-29T02:47:28.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
42152026-10-29T02:47:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
42162026-10-29T02:47:28.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
42172026-10-29T02:47:28.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.746532ms iteration = 108 status = {"config_updated":false}
42182026-10-29T02:47:30.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 178 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = ffc0cf60-fb8d-40e1-aa72-b9142b7b803f response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
42192026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 109 reason = Timeout
42202026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
42212026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 19 reason = Timeout
42222026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
42232026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
42242026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
42252026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42262026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42272026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 10 reason = Timeout
42282026-10-29T02:47:33.726ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
42292026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 10 reason = Timeout
42302026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
42312026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
42322026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 10 reason = Timeout
42332026-10-29T02:47:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
42342026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
42352026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
42362026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
42372026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42382026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42392026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
42402026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42412026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42422026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
42432026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42442026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
42452026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42462026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
42472026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
42482026-10-29T02:47:33.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:37:33.726852806 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42492026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42502026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
42512026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42522026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 19 reason = Timeout
42532026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 25 reason = Timeout
42542026-10-29T02:47:33.726ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
42552026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
42562026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 9.78\u{b5}s iteration = 25 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
42572026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
42582026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
42592026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
42602026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 19 reason = Timeout
42612026-10-29T02:47:33.726ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
42622026-10-29T02:47:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
42632026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
42642026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
42652026-10-29T02:47:33.727ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = ExternalNetworking step id = Ensure
42662026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
42672026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
42682026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42692026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
42702026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
42712026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42722026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42732026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
42742026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
42752026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42762026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42772026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
42782026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42792026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
42802026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
42812026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
42822026-10-29T02:47:33.727ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42832026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42842026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 37 reason = Timeout
42852026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
42862026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42872026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 39 reason = Timeout
42882026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
42892026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
42902026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42912026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
42922026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
42932026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 48 reason = Timeout
42942026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
42952026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
42962026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42972026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
42982026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42992026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
43002026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43012026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 26 reason = Timeout
43022026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
43032026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
43042026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
43052026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43062026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 27 reason = Timeout
43072026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
43082026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
43092026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43102026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
43112026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43122026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
43132026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43142026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
43152026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
43162026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
43172026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43182026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43192026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
43202026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
43212026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43222026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43232026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43242026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43252026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43262026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
43272026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
43282026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
43292026-10-29T02:47:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 405873117 } })
43302026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43312026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
43322026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43332026-10-29T02:47:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 405906557 } })
43342026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
43352026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43362026-10-29T02:47:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 405919128 } })
43372026-10-29T02:47:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 405936258 } })
43382026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
43392026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
43402026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43412026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
43422026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43432026-10-29T02:47:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 405983749 } })
43442026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d933ae5c-6b64-46e8-bb26-2e4210a5763b", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43452026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
43462026-10-29T02:47:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43472026-10-29T02:47:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "06876548-fdc1-4466-9737-994fb7104f62", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43482026-10-29T02:47:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43492026-10-29T02:47:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43502026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 983.641\u{b5}s iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43512026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba7a3723-7127-4dfa-b885-d72f7d1dcc97", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43522026-10-29T02:47:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43532026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6e91a3b2-c34d-4c2c-8b0b-94c19888088b", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43542026-10-29T02:47:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43552026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
43562026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43572026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.119823ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43582026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
43592026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "20008ae7-6db7-46e8-919a-b1382b42ec3d", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43602026-10-29T02:47:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43612026-10-29T02:47:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43622026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43632026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.612964ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43642026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.304417ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43652026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe44fa6-515c-42dd-861d-d667c3ab5c27", "content-length": "50", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} })
43662026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c3edcc3-4a24-4df2-90f1-e8f644b0513a", "content-length": "50", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} })
43672026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43682026-10-29T02:47:33.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
43692026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 2.028982ms iteration = 19 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
43702026-10-29T02:47:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
43712026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
43722026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "59394d0f-91bf-4f2c-9287-a72a8b9805c0", "content-length": "681", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} })
43732026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
43742026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
43752026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
43762026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
43772026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
43782026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
43792026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
43802026-10-29T02:47:33.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43822026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43832026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43842026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43852026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43882026-10-29T02:47:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43892026-10-29T02:47:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.093775ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
43902026-10-29T02:47:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43912026-10-29T02:47:33.731ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922026-10-29T02:47:33.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
43932026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
43942026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
43952026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43962026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 10 reason = Timeout
43972026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
43982026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
43992026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
44002026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44012026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
44022026-10-29T02:47:33.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
44032026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44042026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
44052026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44062026-10-29T02:47:33.732ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:37:33.726852806 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44072026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.440373ms iteration = 10 status = {"expiration":"2026-10-29T02:37:33.726852806Z","pruned":[]}
44082026-10-29T02:47:33.732ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
44092026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.523795ms iteration = 10 status = {"by_rx":{},"error":null}
44102026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44112026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44122026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
44132026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44142026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.837691ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44152026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
44162026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
44172026-10-29T02:47:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44182026-10-29T02:47:33.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44192026-10-29T02:47:33.733ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
44202026-10-29T02:47:33.733ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
44212026-10-29T02:47:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44222026-10-29T02:47:33.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44232026-10-29T02:47:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44242026-10-29T02:47:33.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44252026-10-29T02:47:33.734ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 412765750 } })
44262026-10-29T02:47:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44272026-10-29T02:47:33.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44282026-10-29T02:47:33.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44292026-10-29T02:47:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44302026-10-29T02:47:33.735ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
44312026-10-29T02:47:33.735ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 8.709811ms iteration = 19 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
44322026-10-29T02:47:33.735ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 8.922306ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
44332026-10-29T02:47:33.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342026-10-29T02:47:33.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44352026-10-29T02:47:33.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44362026-10-29T02:47:33.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372026-10-29T02:47:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44382026-10-29T02:47:33.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44392026-10-29T02:47:33.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44402026-10-29T02:47:33.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
44412026-10-29T02:47:33.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
44422026-10-29T02:47:33.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44432026-10-29T02:47:33.739ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44442026-10-29T02:47:33.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44452026-10-29T02:47:33.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44462026-10-29T02:47:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44472026-10-29T02:47:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
44482026-10-29T02:47:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44492026-10-29T02:47:33.740ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44502026-10-29T02:47:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44512026-10-29T02:47:33.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
44522026-10-29T02:47:33.741ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
44532026-10-29T02:47:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
44542026-10-29T02:47:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
44552026-10-29T02:47:33.742ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
44562026-10-29T02:47:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
44572026-10-29T02:47:33.742ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
44582026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44592026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44602026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
44612026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
44622026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
44632026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
44642026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
44652026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
44662026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
44672026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
44682026-10-29T02:47:33.743ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44692026-10-29T02:47:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
44702026-10-29T02:47:33.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
44712026-10-29T02:47:33.744ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
44722026-10-29T02:47:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
44732026-10-29T02:47:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44742026-10-29T02:47:33.745ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44752026-10-29T02:47:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44762026-10-29T02:47:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44772026-10-29T02:47:33.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44782026-10-29T02:47:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
44792026-10-29T02:47:33.748ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
44802026-10-29T02:47:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
44812026-10-29T02:47:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
44822026-10-29T02:47:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
44832026-10-29T02:47:33.749ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
44842026-10-29T02:47:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44852026-10-29T02:47:33.750ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 24.033999ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
44862026-10-29T02:47:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
44872026-10-29T02:47:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44882026-10-29T02:47:33.753ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44892026-10-29T02:47:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44902026-10-29T02:47:33.756ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44912026-10-29T02:47:33.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44922026-10-29T02:47:33.760ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44932026-10-29T02:47:33.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44942026-10-29T02:47:33.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44952026-10-29T02:47:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44962026-10-29T02:47:33.779ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44972026-10-29T02:47:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44982026-10-29T02:47:33.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44992026-10-29T02:47:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45002026-10-29T02:47:33.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45012026-10-29T02:47:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45022026-10-29T02:47:33.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45032026-10-29T02:47:33.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45042026-10-29T02:47:33.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45052026-10-29T02:47:33.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45062026-10-29T02:47:33.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45072026-10-29T02:47:33.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082026-10-29T02:47:33.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45092026-10-29T02:47:33.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45102026-10-29T02:47:33.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45112026-10-29T02:47:33.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45122026-10-29T02:47:33.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45132026-10-29T02:47:33.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45142026-10-29T02:47:33.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45152026-10-29T02:47:33.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
45162026-10-29T02:47:33.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
45172026-10-29T02:47:33.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
45182026-10-29T02:47:33.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45192026-10-29T02:47:33.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45202026-10-29T02:47:33.851ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45212026-10-29T02:47:33.851ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45222026-10-29T02:47:33.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45232026-10-29T02:47:33.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
45242026-10-29T02:47:33.858ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
45252026-10-29T02:47:33.859ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
45262026-10-29T02:47:33.859ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "630390d5-1a60-45d6-812f-12fb016a40d7", "content-length": "81", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} })
45272026-10-29T02:47:33.867ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
45282026-10-29T02:47:33.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 140.309026ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45292026-10-29T02:47:33.867ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 140.803417ms iteration = 109 status = {"config_updated":false}
45302026-10-29T02:47:33.869ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312026-10-29T02:47:33.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
45322026-10-29T02:47:33.875ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
45332026-10-29T02:47:33.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
45342026-10-29T02:47:33.878ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45352026-10-29T02:47:33.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45362026-10-29T02:47:33.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45372026-10-29T02:47:33.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
45382026-10-29T02:47:33.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
45392026-10-29T02:47:33.882ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
45402026-10-29T02:47:33.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
45412026-10-29T02:47:33.885ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
45422026-10-29T02:47:33.885ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45432026-10-29T02:47:33.885ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 156.950432ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45442026-10-29T02:47:33.889ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
45452026-10-29T02:47:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45462026-10-29T02:47:33.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45472026-10-29T02:47:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
45482026-10-29T02:47:33.889ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 567971466 } })
45492026-10-29T02:47:33.890ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
45502026-10-29T02:47:33.890ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
45512026-10-29T02:47:33.891ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "db87e318-f60b-4bb2-b3fe-b589a345e1fa", "content-length": "81", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} })
45522026-10-29T02:47:33.892ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 165.661144ms iteration = 10 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
45532026-10-29T02:47:33.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45542026-10-29T02:47:33.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
45552026-10-29T02:47:33.899ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
45562026-10-29T02:47:33.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 172.128998ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
45572026-10-29T02:47:33.899ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 171.955384ms iteration = 37 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
45582026-10-29T02:47:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45592026-10-29T02:47:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
45602026-10-29T02:47:33.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45612026-10-29T02:47:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45622026-10-29T02:47:33.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632026-10-29T02:47:33.905ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 173.513356ms iteration = 10 status = {"samples_queued":6}
45642026-10-29T02:47:33.909ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 177.582511ms iteration = 5 status = {"nsuccess":5}
45652026-10-29T02:47:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45662026-10-29T02:47:33.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45672026-10-29T02:47:33.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45682026-10-29T02:47:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45692026-10-29T02:47:33.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45702026-10-29T02:47:33.913ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45712026-10-29T02:47:33.913ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45722026-10-29T02:47:33.914ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
45732026-10-29T02:47:33.914ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 186.930605ms iteration = 39 status = {"Loaded":{"time_loaded":"2026-10-29T02:47:33.727105291Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
45742026-10-29T02:47:33.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79424121-5e50-43af-b42a-fd47eda0394c", "content-length": "372", "date": "Thu, 29 Oct 2026 02:47:33 GMT"} })
45752026-10-29T02:47:33.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45762026-10-29T02:47:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45772026-10-29T02:47:33.915ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45782026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45792026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45802026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45812026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45822026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45832026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45842026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45852026-10-29T02:47:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45862026-10-29T02:47:33.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 191.418999ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
45872026-10-29T02:47:33.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45882026-10-29T02:47:33.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 192.857438ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45892026-10-29T02:47:33.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45902026-10-29T02:47:33.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
45912026-10-29T02:47:33.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45922026-10-29T02:47:33.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
45932026-10-29T02:47:33.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45942026-10-29T02:47:33.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45952026-10-29T02:47:33.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45962026-10-29T02:47:33.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
45972026-10-29T02:47:33.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45982026-10-29T02:47:33.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45992026-10-29T02:47:33.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46002026-10-29T02:47:33.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46012026-10-29T02:47:33.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46022026-10-29T02:47:33.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46032026-10-29T02:47:33.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46042026-10-29T02:47:33.930ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46052026-10-29T02:47:33.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 204.657383ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46062026-10-29T02:47:33.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072026-10-29T02:47:33.947ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46082026-10-29T02:47:33.947ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46092026-10-29T02:47:33.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46102026-10-29T02:47:33.949ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46112026-10-29T02:47:33.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46122026-10-29T02:47:33.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
46132026-10-29T02:47:33.958ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
46142026-10-29T02:47:33.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
46152026-10-29T02:47:33.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46162026-10-29T02:47:33.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
46172026-10-29T02:47:33.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
46182026-10-29T02:47:33.998ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46192026-10-29T02:47:33.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46202026-10-29T02:47:34.002ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 original_time_started = 2026-10-29 02:46:35.056377 UTC
46212026-10-29T02:47:34.002ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 275.021647ms iteration = 48 status = {"Loaded":{"collection_id":"96e8ac6a-243b-4ac4-ae0f-bb6805148a62","time_loaded":"2026-10-29T02:47:33.727161972Z","time_started":"2026-10-29T02:46:35.056377Z"}}
46222026-10-29T02:47:34.012ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46232026-10-29T02:47:34.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46242026-10-29T02:47:34.014ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
46252026-10-29T02:47:34.014ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 287.795472ms iteration = 55 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
46262026-10-29T02:47:34.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46272026-10-29T02:47:34.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46282026-10-29T02:47:34.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46292026-10-29T02:47:34.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46302026-10-29T02:47:34.022ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46312026-10-29T02:47:34.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46322026-10-29T02:47:34.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46332026-10-29T02:47:34.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 296.651866ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46342026-10-29T02:47:34.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46352026-10-29T02:47:34.024ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
46362026-10-29T02:47:34.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46372026-10-29T02:47:34.027ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46382026-10-29T02:47:34.027ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
46392026-10-29T02:47:34.027ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 301.123489ms iteration = 10 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
46402026-10-29T02:47:34.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46412026-10-29T02:47:34.031ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 304.282815ms iteration = 34 status = {"disks_added":0,"errors":[]}
46422026-10-29T02:47:34.033ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
46432026-10-29T02:47:34.033ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 306.321767ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46442026-10-29T02:47:34.039ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
46452026-10-29T02:47:34.039ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46462026-10-29T02:47:34.039ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46472026-10-29T02:47:34.039ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46482026-10-29T02:47:34.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46492026-10-29T02:47:34.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46502026-10-29T02:47:34.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46512026-10-29T02:47:34.048ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46522026-10-29T02:47:34.048ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46532026-10-29T02:47:34.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46542026-10-29T02:47:34.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
46552026-10-29T02:47:34.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46562026-10-29T02:47:34.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46572026-10-29T02:47:34.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46582026-10-29T02:47:34.050ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
46592026-10-29T02:47:34.056ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46602026-10-29T02:47:34.056ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46612026-10-29T02:47:34.056ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 330.091311ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46622026-10-29T02:47:34.057ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
46632026-10-29T02:47:34.057ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
46642026-10-29T02:47:34.058ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fcb5f18-3363-44bd-b5ee-a7e2ac81b6a6", "content-length": "81", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
46652026-10-29T02:47:34.058ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
46662026-10-29T02:47:34.058ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 331.759746ms iteration = 19 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
46672026-10-29T02:47:34.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
46682026-10-29T02:47:34.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
46692026-10-29T02:47:34.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46702026-10-29T02:47:34.065ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
46712026-10-29T02:47:34.065ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
46722026-10-29T02:47:34.065ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 333.210496ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
46732026-10-29T02:47:34.069ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
46742026-10-29T02:47:34.078ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
46752026-10-29T02:47:34.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46762026-10-29T02:47:34.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46772026-10-29T02:47:34.086ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
46782026-10-29T02:47:34.088ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
46792026-10-29T02:47:34.088ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 361.226599ms iteration = 19 status = {"incomplete_bootstore_configs":[]}
46802026-10-29T02:47:34.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
46812026-10-29T02:47:34.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
46822026-10-29T02:47:34.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832026-10-29T02:47:34.097ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46842026-10-29T02:47:34.097ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
46852026-10-29T02:47:34.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46862026-10-29T02:47:34.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46872026-10-29T02:47:34.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46882026-10-29T02:47:34.098ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
46892026-10-29T02:47:34.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
46902026-10-29T02:47:34.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46912026-10-29T02:47:34.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 374.521604ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46922026-10-29T02:47:34.101ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
46932026-10-29T02:47:34.104ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
46942026-10-29T02:47:34.106ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46952026-10-29T02:47:34.106ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46962026-10-29T02:47:34.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "07fed29a-2e57-4a04-8835-907a6b2fa264", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
46972026-10-29T02:47:34.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46982026-10-29T02:47:34.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46992026-10-29T02:47:34.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47002026-10-29T02:47:34.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47012026-10-29T02:47:34.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47022026-10-29T02:47:34.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47032026-10-29T02:47:34.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47042026-10-29T02:47:34.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47052026-10-29T02:47:34.112ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
47062026-10-29T02:47:34.112ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
47072026-10-29T02:47:34.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47082026-10-29T02:47:34.112ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
47092026-10-29T02:47:34.112ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 385.516942ms iteration = 10 status = {"generation":2}
47102026-10-29T02:47:34.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47112026-10-29T02:47:34.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47122026-10-29T02:47:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47132026-10-29T02:47:34.117ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
47142026-10-29T02:47:34.120ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
47152026-10-29T02:47:34.121ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47162026-10-29T02:47:34.121ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47172026-10-29T02:47:34.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3862d000-3818-4547-a17c-1b12aba6c00f", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
47182026-10-29T02:47:34.122ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.246285ms iteration = 28 status = {}
47192026-10-29T02:47:34.129ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
47202026-10-29T02:47:34.134ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47212026-10-29T02:47:34.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47222026-10-29T02:47:34.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47232026-10-29T02:47:34.135ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
47242026-10-29T02:47:34.135ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 408.670434ms iteration = 26 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
47252026-10-29T02:47:34.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47262026-10-29T02:47:34.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47272026-10-29T02:47:34.141ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
47282026-10-29T02:47:34.143ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
47292026-10-29T02:47:34.146ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
47302026-10-29T02:47:34.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47312026-10-29T02:47:34.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47322026-10-29T02:47:34.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332026-10-29T02:47:34.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
47342026-10-29T02:47:34.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
47352026-10-29T02:47:34.160ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
47362026-10-29T02:47:34.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372026-10-29T02:47:34.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
47382026-10-29T02:47:34.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
47392026-10-29T02:47:34.166ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
47402026-10-29T02:47:34.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
47412026-10-29T02:47:34.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47422026-10-29T02:47:34.167ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
47432026-10-29T02:47:34.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
47442026-10-29T02:47:34.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
47452026-10-29T02:47:34.168ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
47462026-10-29T02:47:34.169ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = SledList step id = Fetch
47472026-10-29T02:47:34.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47482026-10-29T02:47:34.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47492026-10-29T02:47:34.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47502026-10-29T02:47:34.173ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47512026-10-29T02:47:34.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522026-10-29T02:47:34.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
47532026-10-29T02:47:34.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47542026-10-29T02:47:34.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47552026-10-29T02:47:34.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
47562026-10-29T02:47:34.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
47572026-10-29T02:47:34.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
47582026-10-29T02:47:34.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
47592026-10-29T02:47:34.179ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
47602026-10-29T02:47:34.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
47612026-10-29T02:47:34.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47622026-10-29T02:47:34.181ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47632026-10-29T02:47:34.181ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47642026-10-29T02:47:34.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47652026-10-29T02:47:34.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47662026-10-29T02:47:34.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47672026-10-29T02:47:34.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
47682026-10-29T02:47:34.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
47692026-10-29T02:47:34.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47702026-10-29T02:47:34.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47712026-10-29T02:47:34.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47722026-10-29T02:47:34.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732026-10-29T02:47:34.187ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = DeployNexusRecords step id = Ensure
47742026-10-29T02:47:34.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47752026-10-29T02:47:34.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47762026-10-29T02:47:34.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47772026-10-29T02:47:34.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47782026-10-29T02:47:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
47792026-10-29T02:47:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47802026-10-29T02:47:34.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47812026-10-29T02:47:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47822026-10-29T02:47:34.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832026-10-29T02:47:34.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
47852026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47862026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
47872026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
47882026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 461.3851ms iteration = 10 status = {"generation":1}
47892026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
47902026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
47912026-10-29T02:47:34.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
47922026-10-29T02:47:34.194ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "2459fb87-2f5b-40a4-833f-6786b7ca0b24", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
47932026-10-29T02:47:34.194ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
47942026-10-29T02:47:34.194ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
47952026-10-29T02:47:34.194ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 467.534978ms iteration = 10 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
47962026-10-29T02:47:34.194ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Dependency
47972026-10-29T02:47:34.194ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47982026-10-29T02:47:34.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47992026-10-29T02:47:34.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48002026-10-29T02:47:34.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48012026-10-29T02:47:34.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48022026-10-29T02:47:34.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
48032026-10-29T02:47:34.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48042026-10-29T02:47:34.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48052026-10-29T02:47:34.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48062026-10-29T02:47:34.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48072026-10-29T02:47:34.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48082026-10-29T02:47:34.198ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
48092026-10-29T02:47:34.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3045acf-6eb9-4ddd-9050-83375202d72c", "content-length": "691", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
48102026-10-29T02:47:34.199ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
48112026-10-29T02:47:34.199ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
48122026-10-29T02:47:34.199ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
48132026-10-29T02:47:34.199ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 467.384374ms iteration = 19 status = {}
48142026-10-29T02:47:34.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48152026-10-29T02:47:34.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48162026-10-29T02:47:34.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48172026-10-29T02:47:34.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48182026-10-29T02:47:34.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48192026-10-29T02:47:34.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
48202026-10-29T02:47:34.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
48212026-10-29T02:47:34.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48222026-10-29T02:47:34.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48232026-10-29T02:47:34.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48242026-10-29T02:47:34.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48252026-10-29T02:47:34.210ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48262026-10-29T02:47:34.210ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48272026-10-29T02:47:34.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "67a2bda8-0da5-49c4-9418-d74476125c57", "content-length": "372", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
48282026-10-29T02:47:34.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48292026-10-29T02:47:34.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48302026-10-29T02:47:34.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48312026-10-29T02:47:34.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48322026-10-29T02:47:34.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48332026-10-29T02:47:34.273ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = SledAgent step id = Ensure
48342026-10-29T02:47:34.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
48352026-10-29T02:47:34.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48362026-10-29T02:47:34.274ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
48372026-10-29T02:47:34.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48382026-10-29T02:47:34.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "2d23d4f7-7efb-41fd-a8ae-d1fb5ef5ffa4", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
48392026-10-29T02:47:34.280ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = FirewallRules step id = Ensure
48402026-10-29T02:47:34.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48412026-10-29T02:47:34.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48422026-10-29T02:47:34.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48432026-10-29T02:47:34.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48442026-10-29T02:47:34.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48452026-10-29T02:47:34.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48462026-10-29T02:47:34.287ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
48472026-10-29T02:47:34.287ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 560.769386ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48482026-10-29T02:47:34.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48492026-10-29T02:47:34.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48502026-10-29T02:47:34.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48512026-10-29T02:47:34.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48522026-10-29T02:47:34.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
48532026-10-29T02:47:34.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48542026-10-29T02:47:34.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48552026-10-29T02:47:34.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48562026-10-29T02:47:34.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48572026-10-29T02:47:34.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48582026-10-29T02:47:34.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48592026-10-29T02:47:34.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48602026-10-29T02:47:34.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48612026-10-29T02:47:34.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48622026-10-29T02:47:34.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48632026-10-29T02:47:34.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48642026-10-29T02:47:34.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
48652026-10-29T02:47:34.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48662026-10-29T02:47:34.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48672026-10-29T02:47:34.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48682026-10-29T02:47:34.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48692026-10-29T02:47:34.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
48702026-10-29T02:47:34.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48712026-10-29T02:47:34.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48722026-10-29T02:47:34.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732026-10-29T02:47:34.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48742026-10-29T02:47:34.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48752026-10-29T02:47:34.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
48762026-10-29T02:47:34.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48772026-10-29T02:47:34.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48782026-10-29T02:47:34.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48792026-10-29T02:47:34.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48802026-10-29T02:47:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48812026-10-29T02:47:34.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48822026-10-29T02:47:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48832026-10-29T02:47:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48842026-10-29T02:47:34.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
48852026-10-29T02:47:34.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48862026-10-29T02:47:34.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48872026-10-29T02:47:34.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
48882026-10-29T02:47:34.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48892026-10-29T02:47:34.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48902026-10-29T02:47:34.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
48912026-10-29T02:47:34.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
48922026-10-29T02:47:34.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
48932026-10-29T02:47:34.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
48942026-10-29T02:47:34.325ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48952026-10-29T02:47:34.325ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48962026-10-29T02:47:34.325ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7964bc9-0457-4bda-b0c5-64c0bfa445ce", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
48972026-10-29T02:47:34.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48982026-10-29T02:47:34.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48992026-10-29T02:47:34.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49002026-10-29T02:47:34.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49012026-10-29T02:47:34.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49022026-10-29T02:47:34.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49032026-10-29T02:47:34.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49042026-10-29T02:47:34.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49052026-10-29T02:47:34.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
49062026-10-29T02:47:34.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49072026-10-29T02:47:34.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49082026-10-29T02:47:34.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49092026-10-29T02:47:34.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49102026-10-29T02:47:34.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49112026-10-29T02:47:34.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49122026-10-29T02:47:34.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49132026-10-29T02:47:34.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49142026-10-29T02:47:34.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49152026-10-29T02:47:34.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49162026-10-29T02:47:34.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49172026-10-29T02:47:34.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49182026-10-29T02:47:34.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49192026-10-29T02:47:34.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49202026-10-29T02:47:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49212026-10-29T02:47:34.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49222026-10-29T02:47:34.337ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49232026-10-29T02:47:34.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49242026-10-29T02:47:34.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c7ff0c5b-cd67-4ee0-9370-3cb20d60bdb8", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
49252026-10-29T02:47:34.337ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 143.296279ms iteration = 29 status = {}
49262026-10-29T02:47:34.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49272026-10-29T02:47:34.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
49282026-10-29T02:47:34.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49292026-10-29T02:47:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49302026-10-29T02:47:34.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
49312026-10-29T02:47:34.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49322026-10-29T02:47:34.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49332026-10-29T02:47:34.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49342026-10-29T02:47:34.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49352026-10-29T02:47:34.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49362026-10-29T02:47:34.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372026-10-29T02:47:34.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
49382026-10-29T02:47:34.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49392026-10-29T02:47:34.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49402026-10-29T02:47:34.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
49412026-10-29T02:47:34.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49422026-10-29T02:47:34.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49432026-10-29T02:47:34.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49442026-10-29T02:47:34.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49452026-10-29T02:47:34.355ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
49462026-10-29T02:47:34.355ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 628.275079ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49472026-10-29T02:47:34.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49482026-10-29T02:47:34.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49492026-10-29T02:47:34.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49502026-10-29T02:47:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49512026-10-29T02:47:34.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49522026-10-29T02:47:34.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49532026-10-29T02:47:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49542026-10-29T02:47:34.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49552026-10-29T02:47:34.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49562026-10-29T02:47:34.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
49572026-10-29T02:47:34.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49582026-10-29T02:47:34.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49592026-10-29T02:47:34.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49602026-10-29T02:47:34.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49612026-10-29T02:47:34.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49622026-10-29T02:47:34.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49632026-10-29T02:47:34.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49642026-10-29T02:47:34.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49652026-10-29T02:47:34.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49662026-10-29T02:47:34.367ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49672026-10-29T02:47:34.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49682026-10-29T02:47:34.368ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692026-10-29T02:47:34.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
49702026-10-29T02:47:34.370ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49712026-10-29T02:47:34.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49722026-10-29T02:47:34.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49732026-10-29T02:47:34.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49742026-10-29T02:47:34.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752026-10-29T02:47:34.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
49762026-10-29T02:47:34.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49772026-10-29T02:47:34.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49782026-10-29T02:47:34.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49792026-10-29T02:47:34.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49802026-10-29T02:47:34.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49812026-10-29T02:47:34.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49822026-10-29T02:47:34.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
49832026-10-29T02:47:34.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49842026-10-29T02:47:34.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49852026-10-29T02:47:34.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49862026-10-29T02:47:34.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49872026-10-29T02:47:34.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49882026-10-29T02:47:34.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49892026-10-29T02:47:34.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
49902026-10-29T02:47:34.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
49912026-10-29T02:47:34.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
49922026-10-29T02:47:34.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
49932026-10-29T02:47:34.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49942026-10-29T02:47:34.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
49952026-10-29T02:47:34.391ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
49962026-10-29T02:47:34.391ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
49972026-10-29T02:47:34.391ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = d1099ebb-cb07-4b3e-84e7-695ceaf859de parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
49982026-10-29T02:47:34.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
49992026-10-29T02:47:34.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
50002026-10-29T02:47:34.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50012026-10-29T02:47:34.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50022026-10-29T02:47:34.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50032026-10-29T02:47:34.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50042026-10-29T02:47:34.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50052026-10-29T02:47:34.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
50062026-10-29T02:47:34.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
50072026-10-29T02:47:34.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
50082026-10-29T02:47:34.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50092026-10-29T02:47:34.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50102026-10-29T02:47:34.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50112026-10-29T02:47:34.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50122026-10-29T02:47:34.400ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
50132026-10-29T02:47:34.400ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
50142026-10-29T02:47:34.400ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 673.387636ms iteration = 27 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
50152026-10-29T02:47:34.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50162026-10-29T02:47:34.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50172026-10-29T02:47:34.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50182026-10-29T02:47:34.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50192026-10-29T02:47:34.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50202026-10-29T02:47:34.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50212026-10-29T02:47:34.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50222026-10-29T02:47:34.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
50232026-10-29T02:47:34.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50242026-10-29T02:47:34.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50252026-10-29T02:47:34.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50262026-10-29T02:47:34.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50272026-10-29T02:47:34.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50282026-10-29T02:47:34.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50292026-10-29T02:47:34.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50302026-10-29T02:47:34.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
50312026-10-29T02:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50322026-10-29T02:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50332026-10-29T02:47:34.432ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
50342026-10-29T02:47:34.432ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
50352026-10-29T02:47:34.432ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
50362026-10-29T02:47:34.499ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
50372026-10-29T02:47:34.499ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
50382026-10-29T02:47:34.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50392026-10-29T02:47:34.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50402026-10-29T02:47:34.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50412026-10-29T02:47:34.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50422026-10-29T02:47:34.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50432026-10-29T02:47:34.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
50442026-10-29T02:47:34.508ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
50452026-10-29T02:47:34.509ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "df3c3de3-ce08-4c28-bccc-734ad4575d8a", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
50462026-10-29T02:47:34.509ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
50472026-10-29T02:47:34.509ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = Dns step id = Ensure
50482026-10-29T02:47:34.509ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
50492026-10-29T02:47:34.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50502026-10-29T02:47:34.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50512026-10-29T02:47:34.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50522026-10-29T02:47:34.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50532026-10-29T02:47:34.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50542026-10-29T02:47:34.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
50552026-10-29T02:47:34.517ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
50562026-10-29T02:47:34.517ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
50572026-10-29T02:47:34.517ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
50582026-10-29T02:47:34.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50592026-10-29T02:47:34.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50602026-10-29T02:47:34.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612026-10-29T02:47:34.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
50622026-10-29T02:47:34.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50632026-10-29T02:47:34.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50642026-10-29T02:47:34.525ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
50652026-10-29T02:47:34.525ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50662026-10-29T02:47:34.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50672026-10-29T02:47:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50682026-10-29T02:47:34.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50692026-10-29T02:47:34.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
50702026-10-29T02:47:34.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50712026-10-29T02:47:34.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50722026-10-29T02:47:34.537ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
50732026-10-29T02:47:34.537ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
50742026-10-29T02:47:34.537ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
50752026-10-29T02:47:34.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50762026-10-29T02:47:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50772026-10-29T02:47:34.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50782026-10-29T02:47:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50792026-10-29T02:47:34.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50802026-10-29T02:47:34.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
50812026-10-29T02:47:34.605ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
50822026-10-29T02:47:34.605ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
50832026-10-29T02:47:34.605ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
50842026-10-29T02:47:34.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50852026-10-29T02:47:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50862026-10-29T02:47:34.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50872026-10-29T02:47:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
50882026-10-29T02:47:34.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50892026-10-29T02:47:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50902026-10-29T02:47:34.615ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
50912026-10-29T02:47:34.615ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
50922026-10-29T02:47:34.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50932026-10-29T02:47:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50942026-10-29T02:47:34.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50952026-10-29T02:47:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
50962026-10-29T02:47:34.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
50972026-10-29T02:47:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
50982026-10-29T02:47:34.626ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
50992026-10-29T02:47:34.626ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
51002026-10-29T02:47:34.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51012026-10-29T02:47:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51022026-10-29T02:47:34.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51032026-10-29T02:47:34.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
51042026-10-29T02:47:34.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51052026-10-29T02:47:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51062026-10-29T02:47:34.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51072026-10-29T02:47:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51082026-10-29T02:47:34.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51092026-10-29T02:47:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51102026-10-29T02:47:34.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51112026-10-29T02:47:34.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
51122026-10-29T02:47:34.646ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
51132026-10-29T02:47:34.646ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
51142026-10-29T02:47:34.646ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = OmicronZones step id = Cleanup
51152026-10-29T02:47:34.646ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = OmicronZones step id = Cleanup
51162026-10-29T02:47:34.646ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = PhysicalDisks step id = Cleanup
51172026-10-29T02:47:34.646ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = Clickhouse step id = Ensure
51182026-10-29T02:47:34.646ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = Clickhouse step id = Ensure
51192026-10-29T02:47:34.646ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
51202026-10-29T02:47:34.650ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "ca44b15d-292f-434c-be30-e54efcf28ece", "date": "Thu, 29 Oct 2026 02:47:34 GMT"} })
51212026-10-29T02:47:34.650ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = SupportBundles step id = Cleanup
51222026-10-29T02:47:34.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51232026-10-29T02:47:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51242026-10-29T02:47:34.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252026-10-29T02:47:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
51262026-10-29T02:47:34.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51272026-10-29T02:47:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51282026-10-29T02:47:34.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51292026-10-29T02:47:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51302026-10-29T02:47:34.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51312026-10-29T02:47:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
51322026-10-29T02:47:34.668ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = OmicronZones step id = Cleanup
51332026-10-29T02:47:34.668ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
51342026-10-29T02:47:34.668ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
51352026-10-29T02:47:34.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51362026-10-29T02:47:34.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51372026-10-29T02:47:34.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382026-10-29T02:47:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
51392026-10-29T02:47:34.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51402026-10-29T02:47:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51412026-10-29T02:47:34.730ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
51422026-10-29T02:47:34.730ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
51432026-10-29T02:47:34.730ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = OmicronZones step id = Cleanup
51442026-10-29T02:47:34.730ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
51452026-10-29T02:47:34.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51462026-10-29T02:47:34.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51472026-10-29T02:47:34.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51482026-10-29T02:47:34.734ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
51492026-10-29T02:47:34.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51502026-10-29T02:47:34.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51512026-10-29T02:47:34.843ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
51522026-10-29T02:47:34.843ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = Cockroach step id = Ensure
51532026-10-29T02:47:34.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
51542026-10-29T02:47:34.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
51552026-10-29T02:47:34.850ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
51562026-10-29T02:47:34.850ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f41c9e95-b486-4c0d-8020-16b674f5a245 step component = MgsUpdates step id = Ensure
51572026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 11 reason = Dependency
51582026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Dependency
51592026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51602026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51612026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.123468051s iteration = 11 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":2200,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":442145590,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":442145540,"secs":0}},"event_index":1,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":442156950,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":18509985,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":18509945,"secs":0}},"event_index":2,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":460686015,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":86241953,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":86241893,"secs":0}},"event_index":3,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":546946008,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":6300931,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":6300880,"secs":0}},"event_index":4,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":553267110,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":228884727,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":228884677,"secs":0}},"event_index":5,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":782163687,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":137590020,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":137589980,"secs":0}},"event_index":6,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":919762427,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":6460,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":6420,"secs":0}},"event_index":7,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":919782757,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2460,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2430,"secs":0}},"event_index":8,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":919787547,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2860,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":2831,"secs":0}},"event_index":9,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":919792777,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":1700,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":1660,"secs":0}},"event_index":10,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":919796917,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4161666,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":4161626,"secs":0}},"event_index":11,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":923959884,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":17593716,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":17593676,"secs":0}},"event_index":12,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":941562980,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":61586580,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":61586531,"secs":0}},"event_index":13,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":3171750,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":113549490,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":113549430,"secs":0}},"event_index":14,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":116735561,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":6322412,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":6322352,"secs":0}},"event_index":15,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":123069433,"secs":1}},{"data":{"attempt_elapsed":{"nanos":7050,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":7000,"secs":0}},"event_index":16,"execution_id":"f41c9e95-b486-4c0d-8020-16b674f5a245","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":123085983,"secs":1}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
51622026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51632026-10-29T02:47:34.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51642026-10-29T02:47:34.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51652026-10-29T02:47:34.852ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51662026-10-29T02:47:34.855ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
51672026-10-29T02:47:34.855ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51682026-10-29T02:47:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51692026-10-29T02:47:34.856ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51702026-10-29T02:47:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51712026-10-29T02:47:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51722026-10-29T02:47:34.858ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51732026-10-29T02:47:34.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51742026-10-29T02:47:34.859ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(03916cbc-ab4c-4d59-b35d-bbcfd602edc2, 0), (dd5206a3-4950-4298-b192-e23e6c5b5181, 0), (9a208e82-0cd9-43d2-8b54-25502e463b14, 0), (b4913f60-8f28-41d4-8987-4e569b8cd099, 0)] collection_id = 03916cbc-ab4c-4d59-b35d-bbcfd602edc2
51752026-10-29T02:47:34.859ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51762026-10-29T02:47:34.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51772026-10-29T02:47:34.860ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51782026-10-29T02:47:34.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51792026-10-29T02:47:34.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51802026-10-29T02:47:34.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51812026-10-29T02:47:34.865ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
51822026-10-29T02:47:34.865ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 14.95869ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
51832026-10-29T02:47:34.935ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 03916cbc-ab4c-4d59-b35d-bbcfd602edc2 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
51842026-10-29T02:47:34.935ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51852026-10-29T02:47:34.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51862026-10-29T02:47:34.938ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(dd5206a3-4950-4298-b192-e23e6c5b5181, 0), (9a208e82-0cd9-43d2-8b54-25502e463b14, 0), (b4913f60-8f28-41d4-8987-4e569b8cd099, 0), (ed5afff4-f754-4a16-b620-46c47f804657, 0)] collection_id = dd5206a3-4950-4298-b192-e23e6c5b5181
51872026-10-29T02:47:34.938ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51882026-10-29T02:47:34.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51892026-10-29T02:47:35.024ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = dd5206a3-4950-4298-b192-e23e6c5b5181 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
51902026-10-29T02:47:35.024ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51912026-10-29T02:47:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51922026-10-29T02:47:35.028ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(9a208e82-0cd9-43d2-8b54-25502e463b14, 0), (b4913f60-8f28-41d4-8987-4e569b8cd099, 0), (ed5afff4-f754-4a16-b620-46c47f804657, 0), (96e8ac6a-243b-4ac4-ae0f-bb6805148a62, 0)] collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14
51932026-10-29T02:47:35.028ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51942026-10-29T02:47:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51952026-10-29T02:47:35.146ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 9a208e82-0cd9-43d2-8b54-25502e463b14 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 0 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 0 nconfig_reconcilers = 0 ndatasets = 0 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 0 nhost_phase1_active_slots = 0 nhost_phase1_flash_hashes = 0 ninternal_dns = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_external_ips = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 npower_shelf_psus = 0 nrot_pages = 0 nrots = 0 nsled_agents = 0 nsps = 0 nsvcs_enabled_not_online = 0 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
51962026-10-29T02:47:35.147ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51972026-10-29T02:47:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51982026-10-29T02:47:35.150ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(b4913f60-8f28-41d4-8987-4e569b8cd099, 0), (ed5afff4-f754-4a16-b620-46c47f804657, 0), (96e8ac6a-243b-4ac4-ae0f-bb6805148a62, 0)]
51992026-10-29T02:47:35.150ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 828987526 } })
52002026-10-29T02:47:35.152ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 830422596 } })
52012026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
52022026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
52032026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
52042026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63d59f10-5660-4030-ad77-d9fa80155524", "content-length": "50", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52052026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
52062026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e83ac5-4e13-448b-8c4f-aa1274f83bb6", "content-length": "681", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52072026-10-29T02:47:35.153ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
52082026-10-29T02:47:35.154ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b425fd1-7ead-48af-9815-f0c34bedf438", "content-length": "734", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52092026-10-29T02:47:35.154ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
52102026-10-29T02:47:35.154ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfe062f0-50d3-4076-a205-f99ea259c921", "content-length": "111", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52112026-10-29T02:47:35.154ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
52122026-10-29T02:47:35.155ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6184269c-577e-4a40-a66a-6f39b090bd74", "content-length": "111", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52132026-10-29T02:47:35.155ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
52142026-10-29T02:47:35.155ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4270f61-f667-4908-91ec-0db289d3c5f9", "content-length": "163", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52152026-10-29T02:47:35.155ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
52162026-10-29T02:47:35.156ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "be162032-ebf3-4b0c-a3aa-a3e01c516967", "content-length": "163", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52172026-10-29T02:47:35.156ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
52182026-10-29T02:47:35.156ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5392fd6b-f82d-446e-9a4f-cdba3e39e14d", "content-length": "166", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52192026-10-29T02:47:35.156ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
52202026-10-29T02:47:35.157ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "072d5620-6e23-4c91-bb8a-433439614a60", "content-length": "166", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52212026-10-29T02:47:35.157ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
52222026-10-29T02:47:35.157ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f941a8-1a9e-4528-9534-4d6fe14770fe", "content-length": "702", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52232026-10-29T02:47:35.157ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
52242026-10-29T02:47:35.157ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "950becb3-2b8a-460b-9080-5203e2d34d2f", "content-length": "727", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52252026-10-29T02:47:35.157ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
52262026-10-29T02:47:35.158ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba6a779e-b266-446b-9823-c332ef0d7e72", "content-length": "729", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52272026-10-29T02:47:35.158ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
52282026-10-29T02:47:35.158ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d11d13c-eed6-41b4-b902-4ce4d03c797a", "content-length": "728", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52292026-10-29T02:47:35.158ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
52302026-10-29T02:47:35.158ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "05387a75-88d7-4649-b967-73952f49d96d", "content-length": "722", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52312026-10-29T02:47:35.158ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
52322026-10-29T02:47:35.159ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f4cbdbf-636d-452a-ae0b-096518ace5ce", "content-length": "10", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52332026-10-29T02:47:35.159ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
52342026-10-29T02:47:35.159ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "62895f25-22fe-4e3f-a7ed-f129f38b1ca7", "content-length": "144", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52352026-10-29T02:47:35.159ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
52362026-10-29T02:47:35.159ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "10b4e1c5-966f-467f-b774-9664fd02d81f", "content-length": "147", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52372026-10-29T02:47:35.159ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
52382026-10-29T02:47:35.160ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce4f580-8be6-473e-8bdd-25198f209570", "content-length": "109", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52392026-10-29T02:47:35.160ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
52402026-10-29T02:47:35.160ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c322071-5c1a-42f0-a396-c122d91d0ece", "content-length": "109", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52412026-10-29T02:47:35.160ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
52422026-10-29T02:47:35.161ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5152dc-b7d9-4f55-a732-9234e23f307b", "content-length": "163", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52432026-10-29T02:47:35.161ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
52442026-10-29T02:47:35.161ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "72216c99-b1d4-43be-8aef-c36277ffce95", "content-length": "163", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52452026-10-29T02:47:35.161ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
52462026-10-29T02:47:35.162ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "233b3bcf-a0c5-4ed8-ae73-b656ceaaff21", "content-length": "166", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52472026-10-29T02:47:35.162ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
52482026-10-29T02:47:35.162ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f538a71f-cd84-418f-84e7-e00e16af9863", "content-length": "166", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52492026-10-29T02:47:35.162ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
52502026-10-29T02:47:35.162ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a91b32d4-b4f2-4e8f-b1a2-9f1d36437d07", "content-length": "702", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52512026-10-29T02:47:35.162ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
52522026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c29a40b4-aeb1-4446-8318-87a8d33a57df", "content-length": "727", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52532026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
52542026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8c638d6-de66-4173-9bbe-cd5631ec9f80", "content-length": "729", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52552026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
52562026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "45f18481-a18d-4154-9b0f-480d8ab786ae", "content-length": "728", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52572026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
52582026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c9bd587-c28d-4317-8a9d-8890d813aada", "content-length": "722", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52592026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
52602026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a5f6aa7-b951-48f1-b658-e72f16c7a389", "content-length": "10", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52612026-10-29T02:47:35.163ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
52622026-10-29T02:47:35.164ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "18a949fa-2aac-4784-a535-e855fcdb3e68", "content-length": "144", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52632026-10-29T02:47:35.164ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
52642026-10-29T02:47:35.164ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a6ce5f1-947c-43ed-b641-59027b06198b", "content-length": "147", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52652026-10-29T02:47:35.164ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
52662026-10-29T02:47:35.164ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb9b4531-a70a-4c6b-91c5-97c1c5e22274", "content-length": "109", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52672026-10-29T02:47:35.164ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
52682026-10-29T02:47:35.165ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb3bc72-fa90-44fe-b51d-429d01b7272a", "content-length": "109", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52692026-10-29T02:47:35.165ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
52702026-10-29T02:47:35.165ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8459533d-ce9a-4bf9-9ed9-e4222512a6a3", "content-length": "163", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52712026-10-29T02:47:35.165ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
52722026-10-29T02:47:35.165ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4909fe2a-fd5b-4cda-9ddd-6139ca7b8e2c", "content-length": "163", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52732026-10-29T02:47:35.165ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
52742026-10-29T02:47:35.166ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb5f3501-8310-458d-a9cf-9889f596406b", "content-length": "166", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52752026-10-29T02:47:35.166ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
52762026-10-29T02:47:35.166ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "04ffd573-273f-4756-9a2d-689fa4c87498", "content-length": "166", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52772026-10-29T02:47:35.166ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
52782026-10-29T02:47:35.166ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d252a82d-2ca2-41db-b2d7-242db5a6bbde", "content-length": "702", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52792026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
52802026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe87e15e-95ad-4511-b8ba-5191861ad4e5", "content-length": "727", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52812026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
52822026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "88882d1c-4530-43ec-ae9f-23c3308ecc22", "content-length": "729", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52832026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
52842026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bef1b7b5-7d5e-43f5-81c6-f133e7f9a98f", "content-length": "728", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52852026-10-29T02:47:35.167ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52862026-10-29T02:47:35.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52872026-10-29T02:47:35.169ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52882026-10-29T02:47:35.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
52892026-10-29T02:47:35.172ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52902026-10-29T02:47:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52912026-10-29T02:47:35.174ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52922026-10-29T02:47:35.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
52932026-10-29T02:47:35.176ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52942026-10-29T02:47:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52952026-10-29T02:47:35.278ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
52962026-10-29T02:47:35.278ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
52972026-10-29T02:47:35.326ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e9ce7f-3836-462d-a09f-d974edf02a60", "content-length": "93658", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
52982026-10-29T02:47:35.327ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
52992026-10-29T02:47:35.327ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
53002026-10-29T02:47:35.327ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
53012026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
53022026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
53032026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
53042026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
53052026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
53062026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "087bf1d8-30ae-4601-9691-2c055b418891", "content-length": "64", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53072026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
53082026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2b0c855-1e57-4320-8cb0-bf46b9c02491", "content-length": "64", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53092026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dc4628d-cc33-4ad6-a8b0-187e2cbd4418", "content-length": "64", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53102026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "767c081a-7298-4f96-bd26-47b12969f2f5", "content-length": "64", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53112026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
53122026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
53132026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
53142026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6471fa4-2c4f-4bd0-81cc-1566c1a64c6f", "content-length": "64", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53152026-10-29T02:47:35.327ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
53162026-10-29T02:47:35.333ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "e72de4d8-4c72-4afd-b35e-65b9e97b8db4", "content-length": "412320", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53172026-10-29T02:47:35.334ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "af28c269-da6e-4b0f-8d38-4f6e31e57db6", "content-length": "414448", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53182026-10-29T02:47:35.334ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "86ab081b-69cd-4d47-94c5-9e571d507bc3", "content-length": "414449", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53192026-10-29T02:47:35.336ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "86d722ec-250c-473b-9f61-5501fff74a93", "content-length": "424594", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53202026-10-29T02:47:35.342ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "af863ed9-21a2-429c-8f26-8a8c86fed359", "content-length": "413950", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53212026-10-29T02:47:35.344ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
53222026-10-29T02:47:35.344ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
53232026-10-29T02:47:35.344ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
53242026-10-29T02:47:35.344ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
53252026-10-29T02:47:35.344ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
53262026-10-29T02:47:35.345ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
53272026-10-29T02:47:35.345ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
53282026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bcdbd06-c777-44b4-91da-883a567e37f3", "content-length": "255", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53292026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
53302026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
53312026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
53322026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
53332026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
53342026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
53352026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
53362026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9073be94-7936-4dcf-b365-2743bdf14487", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53372026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c220c24-81d9-495e-9764-3624a08d1262", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53382026-10-29T02:47:35.348ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a28b2063-c86a-4840-8433-e02f8795bc9e", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:47:35 GMT"} })
53392026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
53402026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
53412026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
53422026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
53432026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
53442026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53452026-10-29T02:47:35.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53462026-10-29T02:47:35.351ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53472026-10-29T02:47:35.354ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
53482026-10-29T02:47:35.354ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53492026-10-29T02:47:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53502026-10-29T02:47:35.452ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = a7af1df2-c076-4588-af77-22c33075ab6c file = nexus/db-queries/src/db/datastore/inventory.rs:2241
53512026-10-29T02:47:35.452ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = a7af1df2-c076-4588-af77-22c33075ab6c time_started = 2026-10-29 02:47:35.152999 UTC
53522026-10-29T02:47:35.452ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 49 reason = Dependency
53532026-10-29T02:47:35.452ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53542026-10-29T02:47:35.452ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 602.148736ms iteration = 11 status = {"collection_id":"a7af1df2-c076-4588-af77-22c33075ab6c","time_done":"2026-10-29 02:47:35.349111 UTC","time_started":"2026-10-29 02:47:35.152999 UTC"}
53552026-10-29T02:47:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53562026-10-29T02:47:35.454ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53572026-10-29T02:47:35.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
53582026-10-29T02:47:35.458ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53592026-10-29T02:47:35.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53602026-10-29T02:47:35.502ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53612026-10-29T02:47:35.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53622026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 115.407249ms iteration = 49 status = {"Loaded":{"collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","time_loaded":"2026-10-29T02:47:35.452274949Z","time_started":"2026-10-29T02:47:35.158361Z"}}
53632026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 28 reason = Dependency
53642026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Dependency
53652026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 25 reason = Dependency
53662026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53672026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
53682026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 19 reason = Dependency
53692026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
53702026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 26 reason = Dependency
53712026-10-29T02:47:35.567ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
53722026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53732026-10-29T02:47:35.567ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 17.071\u{b5}s iteration = 26 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
53742026-10-29T02:47:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
53752026-10-29T02:47:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
53762026-10-29T02:47:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53772026-10-29T02:47:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53782026-10-29T02:47:35.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53792026-10-29T02:47:35.570ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802026-10-29T02:47:35.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812026-10-29T02:47:35.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53822026-10-29T02:47:35.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
53832026-10-29T02:47:35.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53842026-10-29T02:47:35.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
53852026-10-29T02:47:35.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53862026-10-29T02:47:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
53872026-10-29T02:47:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53882026-10-29T02:47:35.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
53892026-10-29T02:47:35.576ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
53902026-10-29T02:47:35.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
53912026-10-29T02:47:35.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53922026-10-29T02:47:35.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53932026-10-29T02:47:35.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942026-10-29T02:47:35.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952026-10-29T02:47:35.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53962026-10-29T02:47:35.577ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972026-10-29T02:47:35.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53982026-10-29T02:47:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53992026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
54002026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
54012026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54022026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54032026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
54042026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54052026-10-29T02:47:35.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54062026-10-29T02:47:35.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
54072026-10-29T02:47:35.581ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54082026-10-29T02:47:35.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54092026-10-29T02:47:35.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
54102026-10-29T02:47:35.582ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54112026-10-29T02:47:35.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54122026-10-29T02:47:35.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54132026-10-29T02:47:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
54142026-10-29T02:47:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54152026-10-29T02:47:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54162026-10-29T02:47:35.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54172026-10-29T02:47:35.584ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54182026-10-29T02:47:35.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192026-10-29T02:47:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54202026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54212026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54222026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54232026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54242026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
54252026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
54262026-10-29T02:47:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54272026-10-29T02:47:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
54282026-10-29T02:47:35.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54292026-10-29T02:47:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54302026-10-29T02:47:35.588ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54312026-10-29T02:47:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54322026-10-29T02:47:35.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332026-10-29T02:47:35.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54342026-10-29T02:47:35.590ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
54362026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
54372026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54382026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54392026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
54402026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54412026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
54422026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54432026-10-29T02:47:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54442026-10-29T02:47:35.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452026-10-29T02:47:35.596ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54462026-10-29T02:47:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54472026-10-29T02:47:35.598ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54482026-10-29T02:47:35.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54492026-10-29T02:47:35.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54502026-10-29T02:47:35.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54512026-10-29T02:47:35.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54522026-10-29T02:47:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54532026-10-29T02:47:35.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
54542026-10-29T02:47:35.603ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54552026-10-29T02:47:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54562026-10-29T02:47:35.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572026-10-29T02:47:35.606ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54582026-10-29T02:47:35.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54592026-10-29T02:47:35.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54602026-10-29T02:47:35.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54612026-10-29T02:47:35.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54622026-10-29T02:47:35.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632026-10-29T02:47:35.610ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642026-10-29T02:47:35.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54652026-10-29T02:47:35.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54662026-10-29T02:47:35.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54672026-10-29T02:47:35.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
54682026-10-29T02:47:35.613ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54692026-10-29T02:47:35.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54702026-10-29T02:47:35.614ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
54712026-10-29T02:47:35.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54722026-10-29T02:47:35.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54732026-10-29T02:47:35.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742026-10-29T02:47:35.617ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54752026-10-29T02:47:35.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54762026-10-29T02:47:35.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54772026-10-29T02:47:35.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54782026-10-29T02:47:35.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54792026-10-29T02:47:35.619ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802026-10-29T02:47:35.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812026-10-29T02:47:35.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
54822026-10-29T02:47:35.622ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54832026-10-29T02:47:35.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54842026-10-29T02:47:35.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54852026-10-29T02:47:35.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54862026-10-29T02:47:35.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54872026-10-29T02:47:35.625ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
54882026-10-29T02:47:35.625ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54892026-10-29T02:47:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
54902026-10-29T02:47:35.625ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
54912026-10-29T02:47:35.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54922026-10-29T02:47:35.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54932026-10-29T02:47:35.626ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942026-10-29T02:47:35.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54952026-10-29T02:47:35.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
54962026-10-29T02:47:35.630ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
54972026-10-29T02:47:35.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54982026-10-29T02:47:35.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54992026-10-29T02:47:35.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55002026-10-29T02:47:35.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
55012026-10-29T02:47:35.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55022026-10-29T02:47:35.634ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
55032026-10-29T02:47:35.634ZINFOnexus (BackgroundTasks): building sitrep dd24a770-a85d-4b53-85b2-c6adb1e4ee27 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = dd24a770-a85d-4b53-85b2-c6adb1e4ee27 (sitrep)
55042026-10-29T02:47:35.634ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
55052026-10-29T02:47:35.635ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 66.771387ms iteration = 25 status = {"inv_collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:47:35.634431695Z","outcome":"Unchanged","start_time":"2026-10-29T02:47:35.634401674Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
55062026-10-29T02:47:35.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55072026-10-29T02:47:35.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55082026-10-29T02:47:35.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55092026-10-29T02:47:35.638ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
55102026-10-29T02:47:35.638ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 17 reason = Dependency
55112026-10-29T02:47:35.638ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
55122026-10-29T02:47:35.638ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 70.72801ms iteration = 19 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
55132026-10-29T02:47:35.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
55142026-10-29T02:47:35.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55152026-10-29T02:47:35.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55162026-10-29T02:47:35.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172026-10-29T02:47:35.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55182026-10-29T02:47:35.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55192026-10-29T02:47:35.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55202026-10-29T02:47:35.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55212026-10-29T02:47:35.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55222026-10-29T02:47:35.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55232026-10-29T02:47:35.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
55242026-10-29T02:47:35.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55252026-10-29T02:47:35.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55262026-10-29T02:47:35.701ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
55272026-10-29T02:47:35.701ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 62.926998ms iteration = 17 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
55282026-10-29T02:47:35.701ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 27 reason = Dependency
55292026-10-29T02:47:35.701ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
55302026-10-29T02:47:35.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
55312026-10-29T02:47:35.705ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
55322026-10-29T02:47:35.705ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 4.547064ms iteration = 27 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
55332026-10-29T02:47:35.732ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.809956ms iteration = 35 status = {"disks_added":0,"errors":[]}
55342026-10-29T02:47:35.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55352026-10-29T02:47:35.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55362026-10-29T02:47:35.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372026-10-29T02:47:35.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
55382026-10-29T02:47:35.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55392026-10-29T02:47:35.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55402026-10-29T02:47:35.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55412026-10-29T02:47:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55422026-10-29T02:47:35.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432026-10-29T02:47:35.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
55442026-10-29T02:47:35.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55452026-10-29T02:47:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55462026-10-29T02:47:35.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55472026-10-29T02:47:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55482026-10-29T02:47:35.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55492026-10-29T02:47:35.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
55502026-10-29T02:47:35.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55512026-10-29T02:47:35.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55522026-10-29T02:47:35.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55532026-10-29T02:47:35.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55542026-10-29T02:47:35.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552026-10-29T02:47:35.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
55562026-10-29T02:47:35.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55572026-10-29T02:47:35.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55582026-10-29T02:47:35.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55592026-10-29T02:47:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55602026-10-29T02:47:35.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55612026-10-29T02:47:35.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
55622026-10-29T02:47:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55632026-10-29T02:47:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55642026-10-29T02:47:35.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55652026-10-29T02:47:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55662026-10-29T02:47:35.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55672026-10-29T02:47:35.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55682026-10-29T02:47:35.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55692026-10-29T02:47:35.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
55702026-10-29T02:47:35.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55712026-10-29T02:47:35.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55722026-10-29T02:47:35.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55732026-10-29T02:47:35.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55742026-10-29T02:47:35.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55752026-10-29T02:47:35.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
55762026-10-29T02:47:35.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55772026-10-29T02:47:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55782026-10-29T02:47:35.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55792026-10-29T02:47:35.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55802026-10-29T02:47:35.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55812026-10-29T02:47:35.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
55822026-10-29T02:47:35.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55832026-10-29T02:47:35.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55842026-10-29T02:47:35.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55852026-10-29T02:47:35.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55862026-10-29T02:47:35.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55872026-10-29T02:47:35.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
55882026-10-29T02:47:35.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55892026-10-29T02:47:35.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55902026-10-29T02:47:35.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55912026-10-29T02:47:35.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55922026-10-29T02:47:35.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55932026-10-29T02:47:35.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
55942026-10-29T02:47:35.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55952026-10-29T02:47:35.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55962026-10-29T02:47:35.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
55972026-10-29T02:47:35.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
55982026-10-29T02:47:35.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55992026-10-29T02:47:35.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
56002026-10-29T02:47:35.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
56012026-10-29T02:47:35.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
56022026-10-29T02:47:35.999ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
56032026-10-29T02:47:35.999ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
56042026-10-29T02:47:35.999ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = b4c4a8cb-e34b-4fa9-88b7-db6169f274a8 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
56052026-10-29T02:47:35.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
56062026-10-29T02:47:35.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
56072026-10-29T02:47:36.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56082026-10-29T02:47:36.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
56092026-10-29T02:47:36.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
56102026-10-29T02:47:36.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
56112026-10-29T02:47:36.010ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
56122026-10-29T02:47:36.010ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
56132026-10-29T02:47:36.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 442.60612ms iteration = 28 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
56142026-10-29T02:47:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 110 reason = Timeout
56152026-10-29T02:47:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56162026-10-29T02:47:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56172026-10-29T02:47:38.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56182026-10-29T02:47:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
56192026-10-29T02:47:38.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56202026-10-29T02:47:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56212026-10-29T02:47:38.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
56222026-10-29T02:47:38.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.228521ms iteration = 110 status = {"config_updated":false}
56232026-10-29T02:47:40.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 149 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = bc0a3080-d1ab-4f2c-9815-99462224f970 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
56242026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 111 reason = Timeout
56252026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56262026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
56272026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56282026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
56292026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56302026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56312026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56322026-10-29T02:47:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
56332026-10-29T02:47:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342026-10-29T02:47:43.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56352026-10-29T02:47:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56362026-10-29T02:47:43.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56372026-10-29T02:47:43.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.443962ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56382026-10-29T02:47:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56392026-10-29T02:47:43.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402026-10-29T02:47:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
56412026-10-29T02:47:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
56422026-10-29T02:47:43.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56432026-10-29T02:47:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56442026-10-29T02:47:43.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56452026-10-29T02:47:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
56462026-10-29T02:47:43.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
56472026-10-29T02:47:43.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.849165ms iteration = 111 status = {"config_updated":false}
56482026-10-29T02:47:43.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56492026-10-29T02:47:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
56502026-10-29T02:47:43.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56512026-10-29T02:47:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
56522026-10-29T02:47:43.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
56532026-10-29T02:47:43.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.199426ms iteration = 56 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
56542026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 112 reason = Timeout
56552026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56562026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 40 reason = Timeout
56572026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
56582026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 50 reason = Timeout
56592026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
56602026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 38 reason = Timeout
56612026-10-29T02:47:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
56622026-10-29T02:47:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56632026-10-29T02:47:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
56642026-10-29T02:47:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
56652026-10-29T02:47:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
56662026-10-29T02:47:48.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56672026-10-29T02:47:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56682026-10-29T02:47:48.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56692026-10-29T02:47:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56702026-10-29T02:47:48.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
56712026-10-29T02:47:48.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
56722026-10-29T02:47:48.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
56732026-10-29T02:47:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
56742026-10-29T02:47:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56752026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
56762026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
56772026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56782026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
56792026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
56802026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
56812026-10-29T02:47:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
56822026-10-29T02:47:48.736ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
56832026-10-29T02:47:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.481577ms iteration = 40 status = {"Loaded":{"time_loaded":"2026-10-29T02:47:48.726714056Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
56842026-10-29T02:47:48.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = d52917d2-815c-4745-8ea7-d1682641cd38 original_time_started = 2026-10-29 02:47:35.158361 UTC
56852026-10-29T02:47:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.543929ms iteration = 50 status = {"Loaded":{"collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","time_loaded":"2026-10-29T02:47:48.726764557Z","time_started":"2026-10-29T02:47:35.158361Z"}}
56862026-10-29T02:47:48.737ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
56872026-10-29T02:47:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.777574ms iteration = 112 status = {"config_updated":false}
56882026-10-29T02:47:48.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
56892026-10-29T02:47:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.700042ms iteration = 38 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
56902026-10-29T02:47:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 125 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 77740937-05b9-45f5-9600-df665f391e1f response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
56912026-10-29T02:47:53.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 113 reason = Timeout
56922026-10-29T02:47:53.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
56932026-10-29T02:47:53.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
56942026-10-29T02:47:53.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56952026-10-29T02:47:53.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
56962026-10-29T02:47:53.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56972026-10-29T02:47:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
56982026-10-29T02:47:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
56992026-10-29T02:47:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57002026-10-29T02:47:53.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57012026-10-29T02:47:53.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57022026-10-29T02:47:53.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57032026-10-29T02:47:53.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57042026-10-29T02:47:53.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.858321ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57052026-10-29T02:47:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
57062026-10-29T02:47:53.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
57072026-10-29T02:47:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57082026-10-29T02:47:53.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57092026-10-29T02:47:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
57102026-10-29T02:47:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
57112026-10-29T02:47:53.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
57122026-10-29T02:47:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.284933ms iteration = 113 status = {"config_updated":false}
57132026-10-29T02:47:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57142026-10-29T02:47:53.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152026-10-29T02:47:53.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162026-10-29T02:47:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
57172026-10-29T02:47:53.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57182026-10-29T02:47:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
57192026-10-29T02:47:53.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
57202026-10-29T02:47:53.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.632818ms iteration = 57 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
57212026-10-29T02:47:58.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 114 reason = Timeout
57222026-10-29T02:47:58.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
57232026-10-29T02:47:58.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
57242026-10-29T02:47:58.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57252026-10-29T02:47:58.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
57262026-10-29T02:47:58.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
57272026-10-29T02:47:58.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
57282026-10-29T02:47:58.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
57292026-10-29T02:47:58.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.883925ms iteration = 114 status = {"config_updated":false}
57302026-10-29T02:48:00.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 142 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 29f00de3-22cb-430c-8b8e-a5c96dafc0f5 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
57312026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 115 reason = Timeout
57322026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
57332026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
57342026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57352026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
57362026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
57372026-10-29T02:48:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57382026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57392026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57402026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 39 reason = Timeout
57412026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
57422026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
57432026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 20 reason = Timeout
57442026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
57452026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57462026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
57472026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57482026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 41 reason = Timeout
57492026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 20 reason = Timeout
57502026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
57512026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
57522026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
57532026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
57542026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 51 reason = Timeout
57552026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57562026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
57572026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57582026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 20 reason = Timeout
57592026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57602026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
57612026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
57622026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
57632026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57642026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
57652026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
57662026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57672026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57682026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57692026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
57702026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57712026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
57722026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57732026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
57742026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57752026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57762026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
57772026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57782026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
57792026-10-29T02:48:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57802026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57812026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
57822026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57832026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57842026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
57852026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
57862026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
57872026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57882026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57892026-10-29T02:48:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 405300751 } })
57902026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
57912026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57922026-10-29T02:48:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 405332731 } })
57932026-10-29T02:48:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 405395813 } })
57942026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
57952026-10-29T02:48:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
57962026-10-29T02:48:03.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
57972026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "becb533b-0a7c-4a41-affe-2098a9b0b9a9", "content-length": "50", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
57982026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dcd316e-d0c1-4e22-84a1-aa4393beb14c", "content-length": "50", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
57992026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.685825ms iteration = 20 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
58002026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
58012026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58022026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
58032026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce612af-408f-4fd2-a18b-0dbaad4951b2", "content-length": "681", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
58042026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
58052026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
58062026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
58072026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
58082026-10-29T02:48:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
58092026-10-29T02:48:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
58102026-10-29T02:48:03.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
58112026-10-29T02:48:03.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58122026-10-29T02:48:03.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58132026-10-29T02:48:03.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58142026-10-29T02:48:03.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58152026-10-29T02:48:03.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58162026-10-29T02:48:03.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58172026-10-29T02:48:03.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58182026-10-29T02:48:03.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58192026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
58202026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.739939ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
58212026-10-29T02:48:03.731ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58222026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58232026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58242026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58252026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58262026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
58292026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58302026-10-29T02:48:03.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
58312026-10-29T02:48:03.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
58322026-10-29T02:48:03.732ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 410411747 } })
58332026-10-29T02:48:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58342026-10-29T02:48:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
58352026-10-29T02:48:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.419123ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
58362026-10-29T02:48:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.530025ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58372026-10-29T02:48:03.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
58382026-10-29T02:48:03.733ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
58392026-10-29T02:48:03.733ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 6.888854ms iteration = 20 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
58402026-10-29T02:48:03.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.427394ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58412026-10-29T02:48:03.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58422026-10-29T02:48:03.734ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58432026-10-29T02:48:03.734ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58442026-10-29T02:48:03.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58452026-10-29T02:48:03.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58462026-10-29T02:48:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58472026-10-29T02:48:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
58482026-10-29T02:48:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
58492026-10-29T02:48:03.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.268944ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58502026-10-29T02:48:03.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58512026-10-29T02:48:03.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58522026-10-29T02:48:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58532026-10-29T02:48:03.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58542026-10-29T02:48:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58552026-10-29T02:48:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58562026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
58572026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
58582026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
58592026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
58602026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
58612026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
58622026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
58632026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
58642026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58652026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58662026-10-29T02:48:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
58672026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58682026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58692026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
58702026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
58712026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
58722026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
58732026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
58742026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
58752026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58762026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
58772026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
58782026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58792026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58802026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
58812026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
58822026-10-29T02:48:03.742ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
58832026-10-29T02:48:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
58842026-10-29T02:48:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
58852026-10-29T02:48:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
58862026-10-29T02:48:03.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58872026-10-29T02:48:03.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58882026-10-29T02:48:03.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58892026-10-29T02:48:03.747ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
58902026-10-29T02:48:03.747ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 21.130109ms iteration = 115 status = {"config_updated":false}
58912026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58922026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58932026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58942026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
58952026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 22.340494ms iteration = 41 status = {"Loaded":{"time_loaded":"2026-10-29T02:48:03.726302352Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
58962026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = d52917d2-815c-4745-8ea7-d1682641cd38 original_time_started = 2026-10-29 02:47:35.158361 UTC
58972026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 22.344575ms iteration = 51 status = {"Loaded":{"collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","time_loaded":"2026-10-29T02:48:03.726347803Z","time_started":"2026-10-29T02:47:35.158361Z"}}
58982026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58992026-10-29T02:48:03.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59002026-10-29T02:48:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
59012026-10-29T02:48:03.751ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
59022026-10-29T02:48:03.751ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 25.463189ms iteration = 39 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
59032026-10-29T02:48:03.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042026-10-29T02:48:03.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59052026-10-29T02:48:03.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59062026-10-29T02:48:03.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59072026-10-29T02:48:03.753ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59082026-10-29T02:48:03.753ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.307408ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59092026-10-29T02:48:03.754ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59102026-10-29T02:48:03.754ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59112026-10-29T02:48:03.754ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "121eaec1-1a45-47de-89ae-cb6937195c75", "content-length": "372", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
59122026-10-29T02:48:03.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59132026-10-29T02:48:03.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59142026-10-29T02:48:03.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59152026-10-29T02:48:03.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
59162026-10-29T02:48:03.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172026-10-29T02:48:03.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
59182026-10-29T02:48:03.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59192026-10-29T02:48:03.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
59202026-10-29T02:48:03.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59212026-10-29T02:48:03.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59222026-10-29T02:48:03.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59232026-10-29T02:48:03.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59242026-10-29T02:48:03.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59252026-10-29T02:48:03.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59262026-10-29T02:48:03.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
59272026-10-29T02:48:03.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59282026-10-29T02:48:03.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59292026-10-29T02:48:03.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59302026-10-29T02:48:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
59312026-10-29T02:48:03.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59322026-10-29T02:48:03.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59332026-10-29T02:48:03.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59342026-10-29T02:48:03.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
59352026-10-29T02:48:03.824ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
59362026-10-29T02:48:03.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2f453f-e75a-474c-aff4-20c939e82b1b", "content-length": "691", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
59372026-10-29T02:48:03.825ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
59382026-10-29T02:48:03.825ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
59392026-10-29T02:48:03.825ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
59402026-10-29T02:48:03.825ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 93.432572ms iteration = 20 status = {}
59412026-10-29T02:48:03.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59422026-10-29T02:48:03.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59432026-10-29T02:48:03.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
59442026-10-29T02:48:03.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 115.851218ms iteration = 58 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
59452026-10-29T02:48:03.842ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
59462026-10-29T02:48:03.842ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 116.084773ms iteration = 20 status = {"incomplete_bootstore_configs":[]}
59472026-10-29T02:48:03.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 126.867037ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
59482026-10-29T02:48:03.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59492026-10-29T02:48:03.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59502026-10-29T02:48:03.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59512026-10-29T02:48:03.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.513967ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
59522026-10-29T02:48:03.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.964658ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59532026-10-29T02:48:03.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59542026-10-29T02:48:03.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59552026-10-29T02:48:03.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59562026-10-29T02:48:03.867ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
59572026-10-29T02:48:03.868ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
59582026-10-29T02:48:03.868ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0d611a8-21d8-4da4-9e2e-780a3aecb57f", "content-length": "81", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
59592026-10-29T02:48:03.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59602026-10-29T02:48:03.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59612026-10-29T02:48:03.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59622026-10-29T02:48:03.872ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
59632026-10-29T02:48:03.872ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
59642026-10-29T02:48:03.873ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b9ddf19-722d-4044-8732-1cc3ec02fcc2", "content-length": "81", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
59652026-10-29T02:48:03.875ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59662026-10-29T02:48:03.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59672026-10-29T02:48:03.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59682026-10-29T02:48:03.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59692026-10-29T02:48:03.882ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59702026-10-29T02:48:03.882ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59712026-10-29T02:48:03.882ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.105705ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59722026-10-29T02:48:03.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59732026-10-29T02:48:03.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742026-10-29T02:48:03.888ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
59752026-10-29T02:48:03.888ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
59762026-10-29T02:48:03.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59772026-10-29T02:48:03.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59782026-10-29T02:48:03.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59792026-10-29T02:48:03.889ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa19adc-0292-4e50-ac57-b6a241204350", "content-length": "81", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
59802026-10-29T02:48:03.889ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
59812026-10-29T02:48:03.889ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 163.009228ms iteration = 20 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
59822026-10-29T02:48:03.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59832026-10-29T02:48:03.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59842026-10-29T02:48:03.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59852026-10-29T02:48:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59862026-10-29T02:48:03.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59872026-10-29T02:48:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59882026-10-29T02:48:03.916ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
59892026-10-29T02:48:03.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59902026-10-29T02:48:03.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a68c189a-a8db-4e80-b86d-9b59974237fe", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
59912026-10-29T02:48:03.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59922026-10-29T02:48:03.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59932026-10-29T02:48:03.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59942026-10-29T02:48:03.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59952026-10-29T02:48:03.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59962026-10-29T02:48:03.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59972026-10-29T02:48:03.932ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59982026-10-29T02:48:03.932ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59992026-10-29T02:48:03.932ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16b95a41-0b4b-43b8-bb1e-e4f88c9422d9", "date": "Thu, 29 Oct 2026 02:48:03 GMT"} })
60002026-10-29T02:48:03.932ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 206.654395ms iteration = 30 status = {}
60012026-10-29T02:48:03.960ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
60022026-10-29T02:48:03.960ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 234.399052ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
60032026-10-29T02:48:03.984ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 257.939922ms iteration = 36 status = {"disks_added":0,"errors":[]}
60042026-10-29T02:48:08.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 116 reason = Timeout
60052026-10-29T02:48:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60062026-10-29T02:48:08.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60072026-10-29T02:48:08.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60082026-10-29T02:48:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
60092026-10-29T02:48:08.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60102026-10-29T02:48:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60112026-10-29T02:48:08.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
60122026-10-29T02:48:08.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.564149ms iteration = 116 status = {"config_updated":false}
60132026-10-29T02:48:10.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 110 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = b3a471d1-7f39-4010-9389-990db7056421 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
60142026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 117 reason = Timeout
60152026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
60162026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60172026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60182026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
60192026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60202026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60212026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60222026-10-29T02:48:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
60232026-10-29T02:48:13.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60242026-10-29T02:48:13.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60252026-10-29T02:48:13.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60262026-10-29T02:48:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60272026-10-29T02:48:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60282026-10-29T02:48:13.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60292026-10-29T02:48:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
60302026-10-29T02:48:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
60312026-10-29T02:48:13.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60322026-10-29T02:48:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60332026-10-29T02:48:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60342026-10-29T02:48:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
60352026-10-29T02:48:13.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
60362026-10-29T02:48:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.739453ms iteration = 117 status = {"config_updated":false}
60372026-10-29T02:48:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60382026-10-29T02:48:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
60392026-10-29T02:48:13.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60402026-10-29T02:48:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
60412026-10-29T02:48:13.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
60422026-10-29T02:48:13.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.16752ms iteration = 59 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
60432026-10-29T02:48:13.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.408284ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60442026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 118 reason = Timeout
60452026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60462026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 52 reason = Timeout
60472026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
60482026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 40 reason = Timeout
60492026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
60502026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 42 reason = Timeout
60512026-10-29T02:48:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
60522026-10-29T02:48:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60532026-10-29T02:48:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
60542026-10-29T02:48:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
60552026-10-29T02:48:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
60562026-10-29T02:48:18.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60572026-10-29T02:48:18.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60582026-10-29T02:48:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60592026-10-29T02:48:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60602026-10-29T02:48:18.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
60612026-10-29T02:48:18.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
60622026-10-29T02:48:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
60632026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
60642026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
60652026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
60662026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
60672026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
60682026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60692026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
60702026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
60712026-10-29T02:48:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60722026-10-29T02:48:18.736ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
60732026-10-29T02:48:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 10.260763ms iteration = 42 status = {"Loaded":{"time_loaded":"2026-10-29T02:48:18.726583693Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
60742026-10-29T02:48:18.737ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
60752026-10-29T02:48:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 11.448958ms iteration = 118 status = {"config_updated":false}
60762026-10-29T02:48:18.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = d52917d2-815c-4745-8ea7-d1682641cd38 original_time_started = 2026-10-29 02:47:35.158361 UTC
60772026-10-29T02:48:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 11.421187ms iteration = 52 status = {"Loaded":{"collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","time_loaded":"2026-10-29T02:48:18.726521091Z","time_started":"2026-10-29T02:47:35.158361Z"}}
60782026-10-29T02:48:18.738ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
60792026-10-29T02:48:18.738ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 11.596101ms iteration = 40 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
60802026-10-29T02:48:20.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 217 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = fcb15c26-e2e2-48c9-a263-81e417037e1a response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
60812026-10-29T02:48:23.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 119 reason = Timeout
60822026-10-29T02:48:23.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60832026-10-29T02:48:23.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
60842026-10-29T02:48:23.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
60852026-10-29T02:48:23.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60862026-10-29T02:48:23.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60872026-10-29T02:48:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
60882026-10-29T02:48:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
60892026-10-29T02:48:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60902026-10-29T02:48:23.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60912026-10-29T02:48:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60922026-10-29T02:48:23.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60932026-10-29T02:48:23.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942026-10-29T02:48:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60952026-10-29T02:48:23.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60962026-10-29T02:48:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
60972026-10-29T02:48:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
60982026-10-29T02:48:23.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
60992026-10-29T02:48:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
61002026-10-29T02:48:23.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61012026-10-29T02:48:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
61022026-10-29T02:48:23.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
61032026-10-29T02:48:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.529888ms iteration = 119 status = {"config_updated":false}
61042026-10-29T02:48:23.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052026-10-29T02:48:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
61062026-10-29T02:48:23.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61072026-10-29T02:48:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
61082026-10-29T02:48:23.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
61092026-10-29T02:48:23.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.492451ms iteration = 60 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
61102026-10-29T02:48:23.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.45057ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61112026-10-29T02:48:28.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 120 reason = Timeout
61122026-10-29T02:48:28.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
61132026-10-29T02:48:28.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
61142026-10-29T02:48:28.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61152026-10-29T02:48:28.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
61162026-10-29T02:48:28.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
61172026-10-29T02:48:28.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
61182026-10-29T02:48:28.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
61192026-10-29T02:48:28.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.496398ms iteration = 120 status = {"config_updated":false}
61202026-10-29T02:48:30.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 115 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 1a2dd333-9a1e-4526-b3c5-995099f6254f response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
61212026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 121 reason = Timeout
61222026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
61232026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
61242026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61252026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61262026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
61272026-10-29T02:48:33.726ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
61282026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61292026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 12 reason = Timeout
61302026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_rendezvous iteration = 5 reason = Timeout
61312026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61322026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
61332026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61342026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 20 reason = Timeout
61352026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61362026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 31 reason = Timeout
61372026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = sweeping support bundle creation markers roles = RoleSet { roles: {} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
61382026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61392026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 53 reason = Timeout
61402026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 21 reason = Timeout
61412026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
61422026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
61432026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61442026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = creating requested alerts roles = RoleSet { roles: {} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
61452026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = session_cleanup iteration = 3 reason = Timeout
61462026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = session_cleanup roles = RoleSet { roles: {} }
61472026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
61482026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61492026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = audit_log_cleanup iteration = 2 reason = Timeout
61502026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = audit_log_cleanup roles = RoleSet { roles: {} }
61512026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 28 reason = Timeout
61522026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
61532026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
61542026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61552026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 29 reason = Timeout
61562026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
61572026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 4 reason = Timeout
61582026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
61592026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = audit_log_timeout_incomplete iteration = 2 reason = Timeout
61602026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = audit_log_timeout_incomplete roles = RoleSet { roles: {} }
61612026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 41 reason = Timeout
61622026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
61632026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
61642026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
61652026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 37 reason = Timeout
61662026-10-29T02:48:33.726ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
61672026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61682026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 21 reason = Timeout
61692026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
61702026-10-29T02:48:33.726ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = ExternalNetworking step id = Ensure
61712026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
61722026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
61732026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61742026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
61752026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61762026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 43 reason = Timeout
61772026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
61782026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
61792026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61802026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
61812026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
61822026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
61832026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
61842026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_gc iteration = 6 reason = Timeout
61852026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 18 reason = Timeout
61862026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
61872026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
61882026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
61892026-10-29T02:48:33.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:38:33.726941603 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61902026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61912026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 11 reason = Timeout
61922026-10-29T02:48:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
61932026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
61942026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
61952026-10-29T02:48:33.726ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
61962026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61972026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61982026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
61992026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
62002026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62012026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
62022026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62032026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 11 reason = Timeout
62042026-10-29T02:48:33.727ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
62052026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
62062026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_history_pruner iteration = 3 reason = Timeout
62072026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_history_pruner roles = RoleSet { roles: {} }
62082026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_pruner iteration = 3 reason = Timeout
62092026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_pruner roles = RoleSet { roles: {} }
62102026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
62112026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62122026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 11 reason = Timeout
62132026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
62142026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
62152026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
62162026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
62172026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62182026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62192026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
62202026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
62212026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62222026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
62232026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62242026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
62252026-10-29T02:48:33.727ZINFOnexus (SagaQuiesceHandle): saga recovery pass starting file = nexus/types/src/quiesce.rs:511
62262026-10-29T02:48:33.727ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
62272026-10-29T02:48:33.727ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
62282026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
62292026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62302026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = sweeping support bundle creation markers resource = Database result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
62312026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
62322026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 21 reason = Timeout
62332026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
62342026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
62352026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62362026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62372026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62382026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): current sitrep requests no support bundles background_task = fm_rendezvous bundles_created = 0 rendezvous_op = creating requested support bundles sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 total_bundles_requested = 0
62392026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62402026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 26 reason = Timeout
62412026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
62422026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 27 reason = Timeout
62432026-10-29T02:48:33.727ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
62442026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = session_cleanup resource = Database result = Ok(())
62452026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
62462026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62472026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 12.28\u{b5}s iteration = 27 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
62482026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
62492026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = creating requested alerts resource = Database result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
62502026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
62512026-10-29T02:48:33.727ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62522026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = audit_log_cleanup resource = Database result = Ok(())
62532026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62542026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62552026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62562026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62572026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
62582026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = sweeping alert creation markers roles = RoleSet { roles: {} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
62592026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
62602026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
62612026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
62622026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62632026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
62642026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
62652026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = audit_log_timeout_incomplete resource = Database result = Ok(())
62662026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62672026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
62682026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
62692026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
62702026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
62712026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
62722026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
62732026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62742026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62752026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
62762026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_pruner resource = Database result = Ok(())
62772026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62782026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62792026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
62802026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62812026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62822026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_history_pruner resource = Database result = Ok(())
62832026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
62842026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
62852026-10-29T02:48:33.727ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database result = Ok(())
62862026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62872026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
62882026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62892026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
62902026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62912026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
62922026-10-29T02:48:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
62932026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = sweeping alert creation markers resource = Database result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
62942026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
62952026-10-29T02:48:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 406791139 } })
62962026-10-29T02:48:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 406801379 } })
62972026-10-29T02:48:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 406807829 } })
62982026-10-29T02:48:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 406795999 } })
62992026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d0c27312-a3fa-4333-8970-5b59b54a0895", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63002026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63012026-10-29T02:48:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 406870991 } })
63022026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "13f440da-3af4-4517-ad60-ec6ab96cb238", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63032026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63042026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3a342453-0141-453d-8079-645cb1246983", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63052026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63062026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0cc894e0-5527-4fcb-baf0-f7f5b041fc36", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63072026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63082026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63092026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.602194ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63102026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b5708c6a-2a89-45fb-84c5-ed6aa804a9d2", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63112026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63122026-10-29T02:48:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
63132026-10-29T02:48:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.725076ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63142026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
63152026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
63162026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
63172026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.955551ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
63182026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
63192026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.349049ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
63202026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63212026-10-29T02:48:33.729ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
63222026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 3.126715ms iteration = 21 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
63232026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a024d5ab-efc2-4bfa-ba32-996a374e6a4f", "content-length": "50", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} })
63242026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63252026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbcc61db-5e3e-452b-bd86-5c7ec21f7e02", "content-length": "50", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} })
63262026-10-29T02:48:33.729ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
63272026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
63282026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = sweeping alert creation markers roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
63292026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "42ce1bd0-99c2-440a-8f31-0972c0abb82e", "content-length": "681", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} })
63302026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63312026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
63322026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
63332026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
63342026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63352026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
63362026-10-29T02:48:33.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63372026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
63382026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
63392026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63402026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
63412026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_history_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63432026-10-29T02:48:33.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
63442026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
63452026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63462026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
63472026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
63482026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 11 reason = Timeout
63492026-10-29T02:48:33.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
63502026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
63512026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63522026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
63532026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
63542026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63552026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63562026-10-29T02:48:33.732ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
63572026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.231828ms iteration = 11 status = {"by_rx":{},"error":null}
63582026-10-29T02:48:33.732ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 410840913 } })
63592026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
63602026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63612026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63622026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
63642026-10-29T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63652026-10-29T02:48:33.733ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63662026-10-29T02:48:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.185448ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63672026-10-29T02:48:33.733ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
63682026-10-29T02:48:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 6.954885ms iteration = 21 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
63692026-10-29T02:48:33.733ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
63702026-10-29T02:48:33.734ZDEBGnexus (BackgroundTasks): roles background_task = audit_log_timeout_incomplete roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63712026-10-29T02:48:33.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63722026-10-29T02:48:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = sweeping alert creation markers resource = Fleet result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
63732026-10-29T02:48:33.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = sweeping alert creation markers roles = RoleSet { roles: {} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
63742026-10-29T02:48:33.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752026-10-29T02:48:33.735ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63762026-10-29T02:48:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = sweeping alert creation markers resource = Database result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
63772026-10-29T02:48:33.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63782026-10-29T02:48:33.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63792026-10-29T02:48:33.736ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.64327ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
63802026-10-29T02:48:33.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63812026-10-29T02:48:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_history_pruner resource = Fleet result = Ok(())
63822026-10-29T02:48:33.736ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_history_pruner roles = RoleSet { roles: {} }
63832026-10-29T02:48:33.737ZDEBGnexus (BackgroundTasks): roles background_task = audit_log_cleanup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63842026-10-29T02:48:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_history_pruner resource = Database result = Ok(())
63852026-10-29T02:48:33.737ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63862026-10-29T02:48:33.738ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63872026-10-29T02:48:33.738ZDEBGnexus (BackgroundTasks): roles background_task = session_cleanup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882026-10-29T02:48:33.738ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
63892026-10-29T02:48:33.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63902026-10-29T02:48:33.740ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = audit_log_timeout_incomplete resource = AuditLog result = Ok(())
63912026-10-29T02:48:33.740ZDEBGnexus (BackgroundTasks): roles background_task = audit_log_timeout_incomplete roles = RoleSet { roles: {} }
63922026-10-29T02:48:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = audit_log_timeout_incomplete resource = Database result = Ok(())
63932026-10-29T02:48:33.741ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = sweeping support bundle creation markers roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
63942026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63952026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63962026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
63972026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
63982026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63992026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = audit_log_cleanup resource = AuditLog result = Ok(())
64002026-10-29T02:48:33.742ZDEBGnexus (BackgroundTasks): roles background_task = audit_log_cleanup roles = RoleSet { roles: {} }
64012026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
64022026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
64032026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
64042026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = audit_log_cleanup resource = Database result = Ok(())
64052026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
64062026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
64072026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
64082026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
64092026-10-29T02:48:33.743ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
64102026-10-29T02:48:33.744ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64112026-10-29T02:48:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
64122026-10-29T02:48:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
64132026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_pruner resource = BlueprintConfig result = Ok(())
64142026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_pruner roles = RoleSet { roles: {} }
64152026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_pruner resource = Database result = Ok(())
64162026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = session_cleanup resource = Fleet result = Ok(())
64172026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): roles background_task = session_cleanup roles = RoleSet { roles: {} }
64182026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = session_cleanup resource = Database result = Ok(())
64192026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
64202026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
64212026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64222026-10-29T02:48:33.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64232026-10-29T02:48:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
64242026-10-29T02:48:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64252026-10-29T02:48:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64262026-10-29T02:48:33.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64272026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
64282026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
64292026-10-29T02:48:33.750ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64302026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64312026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64322026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64332026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
64342026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
64352026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
64362026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64372026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64382026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64392026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
64402026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64412026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64422026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
64432026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = sweeping support bundle creation markers resource = Fleet result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
64442026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
64452026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): roles background_task = fm_rendezvous rendezvous_op = sweeping support bundle creation markers roles = RoleSet { roles: {} } sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
64462026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
64472026-10-29T02:48:33.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
64482026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64492026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
64502026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
64512026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64522026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
64532026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64542026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
64552026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64562026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
64572026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_rendezvous rendezvous_op = sweeping support bundle creation markers resource = Database result = Ok(()) sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2
64582026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
64592026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64602026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
64612026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64622026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
64632026-10-29T02:48:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64642026-10-29T02:48:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64652026-10-29T02:48:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
64662026-10-29T02:48:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
64672026-10-29T02:48:33.752ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64682026-10-29T02:48:33.752ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:38:33.726941603 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
64692026-10-29T02:48:33.752ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 26.03271ms iteration = 11 status = {"expiration":"2026-10-29T02:38:33.726941603Z","pruned":[]}
64702026-10-29T02:48:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
64712026-10-29T02:48:33.753ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64722026-10-29T02:48:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
64732026-10-29T02:48:33.753ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
64742026-10-29T02:48:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
64752026-10-29T02:48:33.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64762026-10-29T02:48:33.756ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
64772026-10-29T02:48:33.756ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
64782026-10-29T02:48:33.756ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
64792026-10-29T02:48:33.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64802026-10-29T02:48:33.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64812026-10-29T02:48:33.756ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
64822026-10-29T02:48:33.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64832026-10-29T02:48:33.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64842026-10-29T02:48:33.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64852026-10-29T02:48:33.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64862026-10-29T02:48:33.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64872026-10-29T02:48:33.764ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64882026-10-29T02:48:33.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
64892026-10-29T02:48:33.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64902026-10-29T02:48:33.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64912026-10-29T02:48:33.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64922026-10-29T02:48:33.771ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
64932026-10-29T02:48:33.771ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
64942026-10-29T02:48:33.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
64952026-10-29T02:48:33.772ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64962026-10-29T02:48:33.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
64972026-10-29T02:48:33.778ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
64982026-10-29T02:48:33.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
64992026-10-29T02:48:33.783ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65002026-10-29T02:48:33.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65012026-10-29T02:48:33.790ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65022026-10-29T02:48:33.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65032026-10-29T02:48:33.804ZDEBGnexus (BackgroundTasks): sitrep history depth is within the limit, no records will be pruned background_task = fm_sitrep_history_pruner history_pruning_threshold = 2000 sitrep_history_count = 2
65042026-10-29T02:48:33.804ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_history_pruner elapsed = 77.084932ms iteration = 3 status = {"Activated":{"batch_size":1000,"cfg":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"outcome":{"NotPruned":{"count":2}},"pruned":{"batches":0,"total":0,"versions":null}}}
65052026-10-29T02:48:33.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65062026-10-29T02:48:33.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65072026-10-29T02:48:33.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65082026-10-29T02:48:33.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65092026-10-29T02:48:33.846ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
65102026-10-29T02:48:33.850ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65112026-10-29T02:48:33.850ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65122026-10-29T02:48:33.850ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 123.862935ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65132026-10-29T02:48:33.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
65142026-10-29T02:48:33.851ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
65152026-10-29T02:48:33.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
65162026-10-29T02:48:33.865ZDEBGnexus (BackgroundTasks): audit log cleanup: no old entries to delete background_task = audit_log_cleanup cutoff = 2026-07-31 02:48:33.726611707 UTC
65172026-10-29T02:48:33.865ZDEBGnexus (BackgroundTasks): activation complete background_task = audit_log_cleanup elapsed = 138.459317ms iteration = 2 status = {"cutoff":"2026-07-31T02:48:33.726611707Z","error":null,"max_deleted_per_activation":10000,"rows_deleted":0}
65182026-10-29T02:48:33.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65192026-10-29T02:48:33.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65202026-10-29T02:48:33.873ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
65212026-10-29T02:48:33.873ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 146.682869ms iteration = 121 status = {"config_updated":false}
65222026-10-29T02:48:33.874ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
65232026-10-29T02:48:33.874ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 147.759081ms iteration = 43 status = {"Loaded":{"time_loaded":"2026-10-29T02:48:33.726810941Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
65242026-10-29T02:48:33.877ZINFOnexus (BackgroundTasks): sitrep GC completed background_task = fm_sitrep_gc child_tables = {CaseEreport: ChildTableGcStats { rows_deleted: 0, batches: 1 }, AlertRequest: ChildTableGcStats { rows_deleted: 0, batches: 1 }, SupportBundleRequestDataSelectionFlags: ChildTableGcStats { rows_deleted: 0, batches: 1 }, SupportBundleRequestDataSelectionHostInfo: ChildTableGcStats { rows_deleted: 0, batches: 1 }, SupportBundleRequestDataSelectionEreports: ChildTableGcStats { rows_deleted: 0, batches: 1 }, SupportBundleRequestDataSelectionTimeRange: ChildTableGcStats { rows_deleted: 0, batches: 1 }, SupportBundleRequest: ChildTableGcStats { rows_deleted: 0, batches: 1 }, Case: ChildTableGcStats { rows_deleted: 0, batches: 1 }, FmFactPhysicalDisk: ChildTableGcStats { rows_deleted: 0, batches: 1 }, FmFactSaga: ChildTableGcStats { rows_deleted: 0, batches: 1 }, FmFactCertificate: ChildTableGcStats { rows_deleted: 0, batches: 1 }, AnalysisReport: ChildTableGcStats { rows_deleted: 0, batches: 1 }} file = nexus/db-queries/src/db/datastore/fm.rs:1613 sitreps_deleted = 0
65252026-10-29T02:48:33.877ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_gc elapsed = 150.373965ms iteration = 6 status = {"batch_size":1000,"child_tables":{"fm_alert_request":{"batches":1,"rows_deleted":0},"fm_case":{"batches":1,"rows_deleted":0},"fm_ereport_in_case":{"batches":1,"rows_deleted":0},"fm_fact_certificate":{"batches":1,"rows_deleted":0},"fm_fact_physical_disk":{"batches":1,"rows_deleted":0},"fm_fact_saga":{"batches":1,"rows_deleted":0},"fm_sitrep_analysis_report":{"batches":1,"rows_deleted":0},"fm_support_bundle_request":{"batches":1,"rows_deleted":0},"fm_support_bundle_request_data_selection_ereports":{"batches":1,"rows_deleted":0},"fm_support_bundle_request_data_selection_flags":{"batches":1,"rows_deleted":0},"fm_support_bundle_request_data_selection_host_info":{"batches":1,"rows_deleted":0},"fm_support_bundle_request_data_selection_time_range":{"batches":1,"rows_deleted":0}},"errors":[],"orphaned_sitreps_deleted":0,"sitrep_metadata_batches":1}
65262026-10-29T02:48:33.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65272026-10-29T02:48:33.880ZDEBGnexus (BackgroundTasks): session cleanup found no expired sessions background_task = session_cleanup cutoff = 2026-10-28 02:48:33.726574266 UTC
65282026-10-29T02:48:33.880ZDEBGnexus (BackgroundTasks): activation complete background_task = session_cleanup elapsed = 153.433219ms iteration = 3 status = {"cutoff":"2026-10-28T02:48:33.726574266Z","deleted":0,"error":null,"limit":10000}
65292026-10-29T02:48:33.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 153.02043ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
65302026-10-29T02:48:33.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65312026-10-29T02:48:33.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65322026-10-29T02:48:33.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_pruner resource = BlueprintConfig result = Ok(())
65332026-10-29T02:48:33.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_pruner roles = RoleSet { roles: {} }
65342026-10-29T02:48:33.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65352026-10-29T02:48:33.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_pruner resource = Database result = Ok(())
65362026-10-29T02:48:33.887ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
65372026-10-29T02:48:33.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
65382026-10-29T02:48:33.889ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65392026-10-29T02:48:33.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65402026-10-29T02:48:33.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65412026-10-29T02:48:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65422026-10-29T02:48:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65432026-10-29T02:48:33.893ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 165.818846ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
65442026-10-29T02:48:33.896ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65452026-10-29T02:48:33.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462026-10-29T02:48:33.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
65472026-10-29T02:48:33.902ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
65482026-10-29T02:48:33.902ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:572
65492026-10-29T02:48:33.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
65502026-10-29T02:48:33.905ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
65512026-10-29T02:48:33.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 178.717285ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
65522026-10-29T02:48:33.905ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 179.020301ms iteration = 41 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
65532026-10-29T02:48:33.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
65542026-10-29T02:48:33.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65552026-10-29T02:48:33.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
65562026-10-29T02:48:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
65572026-10-29T02:48:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 180.525362ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
65582026-10-29T02:48:33.908ZINFOnexus (SagaQuiesceHandle): saga recovery pass finished blueprint_id = Some(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint)) file = nexus/types/src/quiesce.rs:526 generation = 1
65592026-10-29T02:48:33.908ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 181.38848ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
65602026-10-29T02:48:33.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65612026-10-29T02:48:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65622026-10-29T02:48:33.913ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = d52917d2-815c-4745-8ea7-d1682641cd38 original_time_started = 2026-10-29 02:47:35.158361 UTC
65632026-10-29T02:48:33.913ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 186.64733ms iteration = 53 status = {"Loaded":{"collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","time_loaded":"2026-10-29T02:48:33.726517165Z","time_started":"2026-10-29T02:47:35.158361Z"}}
65642026-10-29T02:48:33.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65652026-10-29T02:48:33.914ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(b4913f60-8f28-41d4-8987-4e569b8cd099, 0), (ed5afff4-f754-4a16-b620-46c47f804657, 0), (96e8ac6a-243b-4ac4-ae0f-bb6805148a62, 0), (8655890d-aec5-4d9f-9c1a-bd655965cbb7, 0)] collection_id = b4913f60-8f28-41d4-8987-4e569b8cd099
65662026-10-29T02:48:33.914ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65672026-10-29T02:48:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
65682026-10-29T02:48:33.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65692026-10-29T02:48:33.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65702026-10-29T02:48:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
65712026-10-29T02:48:33.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65722026-10-29T02:48:33.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65732026-10-29T02:48:33.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65742026-10-29T02:48:33.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65752026-10-29T02:48:33.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65762026-10-29T02:48:33.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65772026-10-29T02:48:33.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65782026-10-29T02:48:33.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65792026-10-29T02:48:33.931ZDEBGnexus (BackgroundTasks): audit log timeout: no stale entries found background_task = audit_log_timeout_incomplete cutoff = 2026-10-28 22:48:33.726674668 UTC
65802026-10-29T02:48:33.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812026-10-29T02:48:33.931ZDEBGnexus (BackgroundTasks): activation complete background_task = audit_log_timeout_incomplete elapsed = 204.866678ms iteration = 2 status = {"cutoff":"2026-10-28T22:48:33.726674668Z","error":null,"max_timed_out_per_activation":1000,"timed_out":0}
65822026-10-29T02:48:33.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
65832026-10-29T02:48:33.933ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65842026-10-29T02:48:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65852026-10-29T02:48:33.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
65862026-10-29T02:48:33.940ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
65872026-10-29T02:48:33.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
65882026-10-29T02:48:33.947ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
65892026-10-29T02:48:33.947ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
65902026-10-29T02:48:33.947ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
65912026-10-29T02:48:33.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65922026-10-29T02:48:33.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65932026-10-29T02:48:33.954ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 222.647438ms iteration = 11 status = {"samples_queued":6}
65942026-10-29T02:48:33.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65952026-10-29T02:48:33.962ZDEBGnexus (BackgroundTasks): all alerts requested by the current sitrep already exist alerts_already_existed = 1 alerts_created = 0 background_task = fm_rendezvous rendezvous_op = creating requested alerts sitrep_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 total_alerts_requested = 1
65962026-10-29T02:48:33.962ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_rendezvous elapsed = 236.472675ms iteration = 5 status = {"alert_marker_gc":{"details":{"batches":1,"errors":[],"rows_deleted":0},"result":{"Executed":{"end":"2026-10-29T02:48:33.800071654Z","start":"2026-10-29T02:48:33.727455464Z"}}},"alerts":{"details":{"alerts_already_existed":1,"alerts_created":0,"current_sitrep_alerts_requested":1,"errors":[],"stale_sitrep":false,"total_alerts_requested":1},"result":{"Executed":{"end":"2026-10-29T02:48:33.962842377Z","start":"2026-10-29T02:48:33.726553695Z"}}},"ereport_marking":{"details":{"batch_size":1000,"batches":0,"ereports_marked_seen":0,"ereports_not_marked_in_sitrep":0,"errors":[],"total_ereports_in_sitrep":0},"result":{"Executed":{"end":"2026-10-29T02:48:33.727265490Z","start":"2026-10-29T02:48:33.727260440Z"}}},"sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","support_bundle_marker_gc":{"details":{"batches":1,"errors":[],"rows_deleted":0},"result":{"Executed":{"end":"2026-10-29T02:48:33.778546416Z","start":"2026-10-29T02:48:33.726491274Z"}}},"support_bundles":{"details":{"bundles_already_existed":0,"bundles_created":0,"current_sitrep_bundles_requested":0,"errors":[],"stale_sitrep":false,"total_bundles_requested":0},"result":{"Executed":{"end":"2026-10-29T02:48:33.727275921Z","start":"2026-10-29T02:48:33.727268220Z"}}}}
65972026-10-29T02:48:33.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
65982026-10-29T02:48:33.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992026-10-29T02:48:33.968ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66002026-10-29T02:48:33.968ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
66012026-10-29T02:48:33.968ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 236.610308ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66022026-10-29T02:48:33.969ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
66032026-10-29T02:48:33.969ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
66042026-10-29T02:48:33.969ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "9090d117-316d-4722-ad9e-226d413a9306", "content-length": "81", "date": "Thu, 29 Oct 2026 02:48:33 GMT"} })
66052026-10-29T02:48:33.970ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66062026-10-29T02:48:33.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66072026-10-29T02:48:33.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66082026-10-29T02:48:33.973ZINFOnexus (BackgroundTasks): keeping all blueprints background_task = blueprint_pruner file = nexus/src/app/background/tasks/blueprint_pruner.rs:249 nfound = 1 nscanned = 1
66092026-10-29T02:48:33.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_pruner elapsed = 246.398431ms iteration = 3 status = {"deleted":[],"errors":[],"nkept_by_policy":1,"ntargets_deleted":0,"ntargets_removable":0,"status":"enabled"}
66102026-10-29T02:48:33.977ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66112026-10-29T02:48:33.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66122026-10-29T02:48:33.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66132026-10-29T02:48:33.982ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66142026-10-29T02:48:33.984ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
66152026-10-29T02:48:33.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
66162026-10-29T02:48:33.984ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
66172026-10-29T02:48:33.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
66182026-10-29T02:48:33.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
66192026-10-29T02:48:33.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66202026-10-29T02:48:33.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66212026-10-29T02:48:33.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 266.689243ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66222026-10-29T02:48:33.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
66232026-10-29T02:48:33.994ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
66242026-10-29T02:48:33.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
66252026-10-29T02:48:33.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66262026-10-29T02:48:33.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
66272026-10-29T02:48:33.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66282026-10-29T02:48:34.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66292026-10-29T02:48:34.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
66302026-10-29T02:48:34.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
66312026-10-29T02:48:34.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
66322026-10-29T02:48:34.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66332026-10-29T02:48:34.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
66342026-10-29T02:48:34.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66352026-10-29T02:48:34.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66362026-10-29T02:48:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66372026-10-29T02:48:34.041ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
66382026-10-29T02:48:34.041ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 314.297023ms iteration = 18 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
66392026-10-29T02:48:34.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402026-10-29T02:48:34.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66412026-10-29T02:48:34.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66422026-10-29T02:48:34.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66432026-10-29T02:48:34.057ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
66442026-10-29T02:48:34.057ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
66452026-10-29T02:48:34.058ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "0366cafe-358b-4179-b3cc-235781b3a180", "content-length": "81", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
66462026-10-29T02:48:34.082ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66472026-10-29T02:48:34.082ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66482026-10-29T02:48:34.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66492026-10-29T02:48:34.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
66502026-10-29T02:48:34.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66512026-10-29T02:48:34.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66522026-10-29T02:48:34.086ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
66532026-10-29T02:48:34.086ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 359.221286ms iteration = 11 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
66542026-10-29T02:48:34.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552026-10-29T02:48:34.091ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
66562026-10-29T02:48:34.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
66572026-10-29T02:48:34.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66582026-10-29T02:48:34.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66592026-10-29T02:48:34.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
66602026-10-29T02:48:34.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
66612026-10-29T02:48:34.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
66622026-10-29T02:48:34.098ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
66632026-10-29T02:48:34.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
66642026-10-29T02:48:34.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66652026-10-29T02:48:34.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66662026-10-29T02:48:34.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 379.047069ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66672026-10-29T02:48:34.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66682026-10-29T02:48:34.108ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
66692026-10-29T02:48:34.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66702026-10-29T02:48:34.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66712026-10-29T02:48:34.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66722026-10-29T02:48:34.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
66732026-10-29T02:48:34.113ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66742026-10-29T02:48:34.113ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66752026-10-29T02:48:34.113ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 386.524074ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66762026-10-29T02:48:34.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66772026-10-29T02:48:34.114ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
66782026-10-29T02:48:34.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66792026-10-29T02:48:34.115ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66802026-10-29T02:48:34.118ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
66812026-10-29T02:48:34.118ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
66822026-10-29T02:48:34.119ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "75bbf197-3c3b-4173-95dc-9ac9788c2054", "content-length": "81", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
66832026-10-29T02:48:34.119ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
66842026-10-29T02:48:34.119ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 392.54516ms iteration = 21 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
66852026-10-29T02:48:34.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66862026-10-29T02:48:34.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 393.921568ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66872026-10-29T02:48:34.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66882026-10-29T02:48:34.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66892026-10-29T02:48:34.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66902026-10-29T02:48:34.121ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66912026-10-29T02:48:34.121ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
66922026-10-29T02:48:34.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66932026-10-29T02:48:34.123ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66942026-10-29T02:48:34.123ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
66952026-10-29T02:48:34.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66962026-10-29T02:48:34.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig result = Ok(())
66972026-10-29T02:48:34.124ZDEBGnexus (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
66982026-10-29T02:48:34.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66992026-10-29T02:48:34.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
67002026-10-29T02:48:34.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
67012026-10-29T02:48:34.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022026-10-29T02:48:34.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
67032026-10-29T02:48:34.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
67042026-10-29T02:48:34.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
67052026-10-29T02:48:34.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
67062026-10-29T02:48:34.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67072026-10-29T02:48:34.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67082026-10-29T02:48:34.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67092026-10-29T02:48:34.154ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
67102026-10-29T02:48:34.155ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 833668302 } })
67112026-10-29T02:48:34.156ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 429.965827ms iteration = 11 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
67122026-10-29T02:48:34.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67132026-10-29T02:48:34.167ZINFOnexus (BackgroundTasks): tuf_repo_prune decision background_task = tuf_repo_pruner file = nexus/src/app/background/tasks/tuf_repo_pruner.rs:153 status = TufRepoPrunerDetails { nkeep_recent_releases: 3, nkeep_recent_uploads: 2, repos_keep_target_release: {}, repos_keep_recent_uploads: {}, repo_prune: None, other_repos_eligible_to_prune: {}, warnings: [] }
67142026-10-29T02:48:34.167ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 440.537777ms iteration = 4 status = {"nkeep_recent_releases":3,"nkeep_recent_uploads":2,"other_repos_eligible_to_prune":[],"repo_prune":null,"repos_keep_recent_uploads":[],"repos_keep_target_release":[],"status":"enabled","warnings":[]}
67152026-10-29T02:48:34.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67162026-10-29T02:48:34.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67172026-10-29T02:48:34.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67182026-10-29T02:48:34.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67192026-10-29T02:48:34.176ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
67202026-10-29T02:48:34.177ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
67212026-10-29T02:48:34.177ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 451.208999ms iteration = 61 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
67222026-10-29T02:48:34.181ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
67232026-10-29T02:48:34.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67242026-10-29T02:48:34.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67252026-10-29T02:48:34.184ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
67262026-10-29T02:48:34.186ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
67272026-10-29T02:48:34.186ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67282026-10-29T02:48:34.186ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
67292026-10-29T02:48:34.186ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 459.93608ms iteration = 11 status = {"generation":2}
67302026-10-29T02:48:34.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67312026-10-29T02:48:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67322026-10-29T02:48:34.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
67332026-10-29T02:48:34.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
67342026-10-29T02:48:34.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352026-10-29T02:48:34.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67362026-10-29T02:48:34.205ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
67372026-10-29T02:48:34.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67382026-10-29T02:48:34.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67392026-10-29T02:48:34.209ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
67402026-10-29T02:48:34.213ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
67412026-10-29T02:48:34.214ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 487.529304ms iteration = 21 status = {"incomplete_bootstore_configs":[]}
67422026-10-29T02:48:34.214ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
67432026-10-29T02:48:34.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67442026-10-29T02:48:34.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67452026-10-29T02:48:34.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67462026-10-29T02:48:34.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
67472026-10-29T02:48:34.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67482026-10-29T02:48:34.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67492026-10-29T02:48:34.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
67502026-10-29T02:48:34.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67512026-10-29T02:48:34.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67522026-10-29T02:48:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67532026-10-29T02:48:34.238ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
67542026-10-29T02:48:34.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67552026-10-29T02:48:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67562026-10-29T02:48:34.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67572026-10-29T02:48:34.249ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
67582026-10-29T02:48:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67592026-10-29T02:48:34.253ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
67602026-10-29T02:48:34.255ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
67612026-10-29T02:48:34.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
67622026-10-29T02:48:34.257ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
67632026-10-29T02:48:34.257ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67642026-10-29T02:48:34.257ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67652026-10-29T02:48:34.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 530.607609ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67662026-10-29T02:48:34.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67672026-10-29T02:48:34.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67682026-10-29T02:48:34.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
67692026-10-29T02:48:34.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
67702026-10-29T02:48:34.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67712026-10-29T02:48:34.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67722026-10-29T02:48:34.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
67732026-10-29T02:48:34.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67742026-10-29T02:48:34.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67752026-10-29T02:48:34.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67762026-10-29T02:48:34.263ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67772026-10-29T02:48:34.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782026-10-29T02:48:34.266ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
67792026-10-29T02:48:34.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
67802026-10-29T02:48:34.269ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
67812026-10-29T02:48:34.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
67822026-10-29T02:48:34.271ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
67832026-10-29T02:48:34.274ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = b4913f60-8f28-41d4-8987-4e569b8cd099 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
67842026-10-29T02:48:34.274ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67852026-10-29T02:48:34.274ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
67862026-10-29T02:48:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
67872026-10-29T02:48:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67882026-10-29T02:48:34.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67892026-10-29T02:48:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67902026-10-29T02:48:34.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 549.313058ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67912026-10-29T02:48:34.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67922026-10-29T02:48:34.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67932026-10-29T02:48:34.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
67942026-10-29T02:48:34.279ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(ed5afff4-f754-4a16-b620-46c47f804657, 0), (96e8ac6a-243b-4ac4-ae0f-bb6805148a62, 0), (8655890d-aec5-4d9f-9c1a-bd655965cbb7, 0), (a7af1df2-c076-4588-af77-22c33075ab6c, 0)] collection_id = ed5afff4-f754-4a16-b620-46c47f804657
67952026-10-29T02:48:34.279ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67962026-10-29T02:48:34.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
67972026-10-29T02:48:34.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67982026-10-29T02:48:34.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
67992026-10-29T02:48:34.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68002026-10-29T02:48:34.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68012026-10-29T02:48:34.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
68022026-10-29T02:48:34.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68032026-10-29T02:48:34.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68042026-10-29T02:48:34.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68052026-10-29T02:48:34.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68062026-10-29T02:48:34.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68072026-10-29T02:48:34.288ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
68082026-10-29T02:48:34.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68092026-10-29T02:48:34.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68102026-10-29T02:48:34.293ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
68112026-10-29T02:48:34.294ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68122026-10-29T02:48:34.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68132026-10-29T02:48:34.299ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
68142026-10-29T02:48:34.299ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68152026-10-29T02:48:34.299ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68162026-10-29T02:48:34.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68172026-10-29T02:48:34.299ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
68182026-10-29T02:48:34.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68192026-10-29T02:48:34.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
68202026-10-29T02:48:34.300ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = SledList step id = Fetch
68212026-10-29T02:48:34.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
68222026-10-29T02:48:34.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68232026-10-29T02:48:34.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68242026-10-29T02:48:34.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
68252026-10-29T02:48:34.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68262026-10-29T02:48:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68272026-10-29T02:48:34.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68282026-10-29T02:48:34.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68292026-10-29T02:48:34.309ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68302026-10-29T02:48:34.309ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312026-10-29T02:48:34.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68322026-10-29T02:48:34.310ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68332026-10-29T02:48:34.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68342026-10-29T02:48:34.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68352026-10-29T02:48:34.310ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3be52315-2bdb-401e-8b22-18b076cae7df", "content-length": "372", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
68362026-10-29T02:48:34.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68372026-10-29T02:48:34.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68382026-10-29T02:48:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68392026-10-29T02:48:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
68402026-10-29T02:48:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
68412026-10-29T02:48:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
68422026-10-29T02:48:34.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
68432026-10-29T02:48:34.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68442026-10-29T02:48:34.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68452026-10-29T02:48:34.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
68462026-10-29T02:48:34.316ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68472026-10-29T02:48:34.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
68482026-10-29T02:48:34.316ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
68492026-10-29T02:48:34.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
68502026-10-29T02:48:34.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68512026-10-29T02:48:34.318ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
68522026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68532026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
68542026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 586.900179ms iteration = 11 status = {"generation":1}
68552026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
68562026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
68572026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
68582026-10-29T02:48:34.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68592026-10-29T02:48:34.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68602026-10-29T02:48:34.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68612026-10-29T02:48:34.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
68622026-10-29T02:48:34.322ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68632026-10-29T02:48:34.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68642026-10-29T02:48:34.323ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68652026-10-29T02:48:34.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
68662026-10-29T02:48:34.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
68672026-10-29T02:48:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68682026-10-29T02:48:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
68692026-10-29T02:48:34.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68702026-10-29T02:48:34.326ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
68712026-10-29T02:48:34.326ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 600.443111ms iteration = 31 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
68722026-10-29T02:48:34.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
68732026-10-29T02:48:34.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
68742026-10-29T02:48:34.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
68752026-10-29T02:48:34.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68762026-10-29T02:48:34.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68772026-10-29T02:48:34.329ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68782026-10-29T02:48:34.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
68792026-10-29T02:48:34.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
68802026-10-29T02:48:34.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68812026-10-29T02:48:34.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
68822026-10-29T02:48:34.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68832026-10-29T02:48:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68842026-10-29T02:48:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
68852026-10-29T02:48:34.335ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68862026-10-29T02:48:34.335ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = DeployNexusRecords step id = Ensure
68872026-10-29T02:48:34.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
68882026-10-29T02:48:34.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
68892026-10-29T02:48:34.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68902026-10-29T02:48:34.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
68912026-10-29T02:48:34.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
68922026-10-29T02:48:34.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
68932026-10-29T02:48:34.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68942026-10-29T02:48:34.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68952026-10-29T02:48:34.338ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68962026-10-29T02:48:34.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68972026-10-29T02:48:34.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68982026-10-29T02:48:34.342ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
68992026-10-29T02:48:34.343ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "0498535f-0510-4f54-b05c-5bfee9022566", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
69002026-10-29T02:48:34.343ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
69012026-10-29T02:48:34.343ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
69022026-10-29T02:48:34.343ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 616.667158ms iteration = 11 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
69032026-10-29T02:48:34.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
69042026-10-29T02:48:34.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
69052026-10-29T02:48:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
69062026-10-29T02:48:34.344ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
69072026-10-29T02:48:34.344ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 617.995665ms iteration = 28 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
69082026-10-29T02:48:34.344ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 29 reason = Dependency
69092026-10-29T02:48:34.344ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
69102026-10-29T02:48:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
69112026-10-29T02:48:34.345ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69122026-10-29T02:48:34.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
69132026-10-29T02:48:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
69142026-10-29T02:48:34.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69152026-10-29T02:48:34.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69162026-10-29T02:48:34.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
69172026-10-29T02:48:34.351ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69182026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69192026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
69202026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
69212026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
69222026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "23d2349f-0a6b-45d3-ad07-0357472d68a5", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
69232026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69242026-10-29T02:48:34.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
69252026-10-29T02:48:34.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
69262026-10-29T02:48:34.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69272026-10-29T02:48:34.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282026-10-29T02:48:34.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292026-10-29T02:48:34.357ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
69302026-10-29T02:48:34.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69312026-10-29T02:48:34.357ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69322026-10-29T02:48:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
69332026-10-29T02:48:34.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
69342026-10-29T02:48:34.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
69352026-10-29T02:48:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69362026-10-29T02:48:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
69372026-10-29T02:48:34.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69382026-10-29T02:48:34.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69392026-10-29T02:48:34.363ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69402026-10-29T02:48:34.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
69412026-10-29T02:48:34.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
69422026-10-29T02:48:34.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
69432026-10-29T02:48:34.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69442026-10-29T02:48:34.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69452026-10-29T02:48:34.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69462026-10-29T02:48:34.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69472026-10-29T02:48:34.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69482026-10-29T02:48:34.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69492026-10-29T02:48:34.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
69502026-10-29T02:48:34.370ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
69512026-10-29T02:48:34.370ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
69522026-10-29T02:48:34.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
69532026-10-29T02:48:34.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69542026-10-29T02:48:34.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
69552026-10-29T02:48:34.372ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
69562026-10-29T02:48:34.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
69572026-10-29T02:48:34.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
69582026-10-29T02:48:34.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69592026-10-29T02:48:34.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69602026-10-29T02:48:34.375ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69612026-10-29T02:48:34.375ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69622026-10-29T02:48:34.376ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3bc4f408-70e9-4f12-8065-ec0cf7336fe4", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
69632026-10-29T02:48:34.376ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 648.987009ms iteration = 31 status = {}
69642026-10-29T02:48:34.376ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Dependency
69652026-10-29T02:48:34.376ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69662026-10-29T02:48:34.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69672026-10-29T02:48:34.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69682026-10-29T02:48:34.376ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = tuf_artifact_replication body = Some(Body) method = PUT operation_id = artifact_config_put uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
69692026-10-29T02:48:34.377ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = tuf_artifact_replication operation_id = artifact_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "0dc60d2e-92d7-487f-a399-0c4b2afffec3", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
69702026-10-29T02:48:34.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = tuf_artifact_replication body = None method = GET operation_id = artifact_list uri = http://[fd00:1122:3344:101::1]:12345/artifacts
69712026-10-29T02:48:34.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = tuf_artifact_replication operation_id = artifact_list result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2f8d14-f8ab-47db-b203-761408de52d1", "content-length": "26", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
69722026-10-29T02:48:34.378ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:650 sled = http://[fd00:1122:3344:101::1]:12345
69732026-10-29T02:48:34.378ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 651.488161ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"2beff0a4-76a3-42da-a94b-cd9b8774ad75","time":"2026-10-29T02:43:34.292053260Z"},{"operation":"list","target_sled":"2beff0a4-76a3-42da-a94b-cd9b8774ad75","time":"2026-10-29T02:43:34.296480383Z"},{"generation":1,"operation":"put_config","target_sled":"2beff0a4-76a3-42da-a94b-cd9b8774ad75","time":"2026-10-29T02:48:34.377731620Z"},{"operation":"list","target_sled":"2beff0a4-76a3-42da-a94b-cd9b8774ad75","time":"2026-10-29T02:48:34.378038446Z"}]}
69742026-10-29T02:48:34.378ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
69752026-10-29T02:48:34.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
69762026-10-29T02:48:34.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
69772026-10-29T02:48:34.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69782026-10-29T02:48:34.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
69792026-10-29T02:48:34.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
69802026-10-29T02:48:34.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
69812026-10-29T02:48:34.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822026-10-29T02:48:34.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69832026-10-29T02:48:34.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69842026-10-29T02:48:34.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69852026-10-29T02:48:34.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69862026-10-29T02:48:34.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69872026-10-29T02:48:34.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69882026-10-29T02:48:34.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
69892026-10-29T02:48:34.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
69902026-10-29T02:48:34.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
69912026-10-29T02:48:34.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922026-10-29T02:48:34.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69932026-10-29T02:48:34.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69942026-10-29T02:48:34.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69952026-10-29T02:48:34.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69962026-10-29T02:48:34.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69972026-10-29T02:48:34.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69982026-10-29T02:48:34.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
69992026-10-29T02:48:34.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70002026-10-29T02:48:34.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70012026-10-29T02:48:34.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70022026-10-29T02:48:34.399ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 673.10625ms iteration = 37 status = {"disks_added":0,"errors":[]}
70032026-10-29T02:48:34.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70042026-10-29T02:48:34.400ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70052026-10-29T02:48:34.400ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
70062026-10-29T02:48:34.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70072026-10-29T02:48:34.400ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70082026-10-29T02:48:34.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70092026-10-29T02:48:34.401ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17776bcd-92e0-4a6c-931b-16ba2b7695d7", "content-length": "372", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
70102026-10-29T02:48:34.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70112026-10-29T02:48:34.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70122026-10-29T02:48:34.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70132026-10-29T02:48:34.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70142026-10-29T02:48:34.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70152026-10-29T02:48:34.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
70162026-10-29T02:48:34.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70172026-10-29T02:48:34.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70182026-10-29T02:48:34.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70192026-10-29T02:48:34.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70202026-10-29T02:48:34.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212026-10-29T02:48:34.415ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
70222026-10-29T02:48:34.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70232026-10-29T02:48:34.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
70242026-10-29T02:48:34.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70252026-10-29T02:48:34.418ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
70262026-10-29T02:48:34.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70272026-10-29T02:48:34.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70282026-10-29T02:48:34.420ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292026-10-29T02:48:34.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70302026-10-29T02:48:34.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70312026-10-29T02:48:34.421ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
70322026-10-29T02:48:34.421ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 19 reason = Dependency
70332026-10-29T02:48:34.421ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
70342026-10-29T02:48:34.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 695.447645ms iteration = 20 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
70352026-10-29T02:48:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
70362026-10-29T02:48:34.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70372026-10-29T02:48:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70382026-10-29T02:48:34.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
70392026-10-29T02:48:34.425ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
70402026-10-29T02:48:34.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
70412026-10-29T02:48:34.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70422026-10-29T02:48:34.428ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
70432026-10-29T02:48:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
70442026-10-29T02:48:34.429ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
70452026-10-29T02:48:34.429ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70462026-10-29T02:48:34.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "707efeaa-77d3-4749-8a96-332af3a20294", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
70472026-10-29T02:48:34.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70482026-10-29T02:48:34.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70492026-10-29T02:48:34.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70502026-10-29T02:48:34.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
70512026-10-29T02:48:34.431ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70522026-10-29T02:48:34.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532026-10-29T02:48:34.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70542026-10-29T02:48:34.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70552026-10-29T02:48:34.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
70562026-10-29T02:48:34.436ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
70572026-10-29T02:48:34.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
70582026-10-29T02:48:34.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70592026-10-29T02:48:34.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70602026-10-29T02:48:34.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
70612026-10-29T02:48:34.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70622026-10-29T02:48:34.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70632026-10-29T02:48:34.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70642026-10-29T02:48:34.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70652026-10-29T02:48:34.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70662026-10-29T02:48:34.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672026-10-29T02:48:34.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70682026-10-29T02:48:34.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70692026-10-29T02:48:34.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70702026-10-29T02:48:34.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70712026-10-29T02:48:34.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
70722026-10-29T02:48:34.446ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70732026-10-29T02:48:34.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70742026-10-29T02:48:34.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1c847e1d-f7a4-4b67-9810-9fe3c8cd46a1", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
70752026-10-29T02:48:34.447ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 70.73016ms iteration = 32 status = {}
70762026-10-29T02:48:34.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70772026-10-29T02:48:34.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70782026-10-29T02:48:34.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70792026-10-29T02:48:34.450ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
70802026-10-29T02:48:34.451ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a34d532f-35c5-4b5e-8eaf-0b8a71933e3a", "content-length": "691", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
70812026-10-29T02:48:34.451ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
70822026-10-29T02:48:34.451ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
70832026-10-29T02:48:34.451ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
70842026-10-29T02:48:34.451ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 719.172248ms iteration = 21 status = {}
70852026-10-29T02:48:34.454ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = ed5afff4-f754-4a16-b620-46c47f804657 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
70862026-10-29T02:48:34.454ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70872026-10-29T02:48:34.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
70882026-10-29T02:48:34.458ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
70892026-10-29T02:48:34.458ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 731.213788ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
70902026-10-29T02:48:34.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70912026-10-29T02:48:34.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70922026-10-29T02:48:34.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70932026-10-29T02:48:34.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70942026-10-29T02:48:34.462ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(96e8ac6a-243b-4ac4-ae0f-bb6805148a62, 0), (8655890d-aec5-4d9f-9c1a-bd655965cbb7, 0), (a7af1df2-c076-4588-af77-22c33075ab6c, 0), (d52917d2-815c-4745-8ea7-d1682641cd38, 0)] collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62
70952026-10-29T02:48:34.462ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70962026-10-29T02:48:34.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
70972026-10-29T02:48:34.464ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
70982026-10-29T02:48:34.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
70992026-10-29T02:48:34.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71002026-10-29T02:48:34.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71012026-10-29T02:48:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71022026-10-29T02:48:34.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71032026-10-29T02:48:34.475ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
71042026-10-29T02:48:34.475ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
71052026-10-29T02:48:34.475ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
71062026-10-29T02:48:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
71072026-10-29T02:48:34.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71082026-10-29T02:48:34.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71092026-10-29T02:48:34.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102026-10-29T02:48:34.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
71112026-10-29T02:48:34.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71122026-10-29T02:48:34.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71132026-10-29T02:48:34.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71142026-10-29T02:48:34.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71152026-10-29T02:48:34.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71162026-10-29T02:48:34.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
71172026-10-29T02:48:34.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71182026-10-29T02:48:34.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71192026-10-29T02:48:34.544ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
71202026-10-29T02:48:34.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
71212026-10-29T02:48:34.548ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71222026-10-29T02:48:34.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
71232026-10-29T02:48:34.553ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
71242026-10-29T02:48:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
71252026-10-29T02:48:34.558ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
71262026-10-29T02:48:34.558ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
71272026-10-29T02:48:34.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
71282026-10-29T02:48:34.566ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71292026-10-29T02:48:34.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
71302026-10-29T02:48:34.570ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
71312026-10-29T02:48:34.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
71322026-10-29T02:48:34.575ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
71332026-10-29T02:48:34.575ZINFOnexus (BackgroundTasks): building sitrep 1e74cabb-71ce-417e-a81f-64bd1cfe55ab (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 1e74cabb-71ce-417e-a81f-64bd1cfe55ab (sitrep)
71342026-10-29T02:48:34.575ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
71352026-10-29T02:48:34.575ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 848.309211ms iteration = 26 status = {"inv_collection_id":"d52917d2-815c-4745-8ea7-d1682641cd38","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:48:34.575547652Z","outcome":"Unchanged","start_time":"2026-10-29T02:48:34.575507441Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
71362026-10-29T02:48:34.582ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = SledAgent step id = Ensure
71372026-10-29T02:48:34.582ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
71382026-10-29T02:48:34.584ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
71392026-10-29T02:48:34.584ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 857.527364ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71402026-10-29T02:48:34.586ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "e4a9ebf0-9ac0-475c-85cd-5dc029ac531e", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
71412026-10-29T02:48:34.586ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = FirewallRules step id = Ensure
71422026-10-29T02:48:34.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71432026-10-29T02:48:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71442026-10-29T02:48:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71452026-10-29T02:48:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71462026-10-29T02:48:34.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71472026-10-29T02:48:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71482026-10-29T02:48:34.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71492026-10-29T02:48:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71502026-10-29T02:48:34.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71512026-10-29T02:48:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71522026-10-29T02:48:34.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71532026-10-29T02:48:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71542026-10-29T02:48:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71552026-10-29T02:48:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
71562026-10-29T02:48:34.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71572026-10-29T02:48:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71582026-10-29T02:48:34.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71592026-10-29T02:48:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71602026-10-29T02:48:34.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71612026-10-29T02:48:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71622026-10-29T02:48:34.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71632026-10-29T02:48:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71642026-10-29T02:48:34.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71652026-10-29T02:48:34.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71662026-10-29T02:48:34.630ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
71672026-10-29T02:48:34.630ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 209.016355ms iteration = 19 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
71682026-10-29T02:48:34.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
71692026-10-29T02:48:34.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71702026-10-29T02:48:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71712026-10-29T02:48:34.633ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
71722026-10-29T02:48:34.633ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
71732026-10-29T02:48:34.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71742026-10-29T02:48:34.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
71752026-10-29T02:48:34.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71762026-10-29T02:48:34.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71772026-10-29T02:48:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71782026-10-29T02:48:34.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71792026-10-29T02:48:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71802026-10-29T02:48:34.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71812026-10-29T02:48:34.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
71822026-10-29T02:48:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
71832026-10-29T02:48:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71842026-10-29T02:48:34.637ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
71852026-10-29T02:48:34.637ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 293.299736ms iteration = 29 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
71862026-10-29T02:48:34.638ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 30 reason = Dependency
71872026-10-29T02:48:34.638ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
71882026-10-29T02:48:34.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71892026-10-29T02:48:34.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71902026-10-29T02:48:34.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
71912026-10-29T02:48:34.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922026-10-29T02:48:34.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71932026-10-29T02:48:34.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71942026-10-29T02:48:34.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71952026-10-29T02:48:34.642ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
71962026-10-29T02:48:34.642ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 4.693138ms iteration = 30 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
71972026-10-29T02:48:34.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
71982026-10-29T02:48:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
71992026-10-29T02:48:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
72002026-10-29T02:48:34.645ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
72012026-10-29T02:48:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
72022026-10-29T02:48:34.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72032026-10-29T02:48:34.646ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = service_firewall_rule_propagation operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "76d473e8-6899-4188-9ecf-f8413dd75d59", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72042026-10-29T02:48:34.646ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:501
72052026-10-29T02:48:34.646ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 919.889759ms
72062026-10-29T02:48:34.646ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 919.9109ms iteration = 4 status = {"lookup_error":null,"sled_push_errors":null}
72072026-10-29T02:48:34.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72082026-10-29T02:48:34.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
72092026-10-29T02:48:34.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
72102026-10-29T02:48:34.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
72112026-10-29T02:48:34.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72122026-10-29T02:48:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
72132026-10-29T02:48:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72142026-10-29T02:48:34.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72152026-10-29T02:48:34.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72162026-10-29T02:48:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72172026-10-29T02:48:34.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72182026-10-29T02:48:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
72192026-10-29T02:48:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
72202026-10-29T02:48:34.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72212026-10-29T02:48:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72222026-10-29T02:48:34.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72232026-10-29T02:48:34.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
72242026-10-29T02:48:34.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72252026-10-29T02:48:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72262026-10-29T02:48:34.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72272026-10-29T02:48:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72282026-10-29T02:48:34.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72292026-10-29T02:48:34.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72302026-10-29T02:48:34.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72312026-10-29T02:48:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72322026-10-29T02:48:34.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72332026-10-29T02:48:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72342026-10-29T02:48:34.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72352026-10-29T02:48:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72362026-10-29T02:48:34.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72372026-10-29T02:48:34.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72382026-10-29T02:48:34.681ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 96e8ac6a-243b-4ac4-ae0f-bb6805148a62 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 0 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 0 nconfig_reconcilers = 0 ndatasets = 0 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 0 nhost_phase1_active_slots = 0 nhost_phase1_flash_hashes = 0 ninternal_dns = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_external_ips = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 npower_shelf_psus = 0 nrot_pages = 0 nrots = 0 nsled_agents = 0 nsps = 0 nsvcs_enabled_not_online = 0 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
72392026-10-29T02:48:34.681ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72402026-10-29T02:48:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
72412026-10-29T02:48:34.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72422026-10-29T02:48:34.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72432026-10-29T02:48:34.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72442026-10-29T02:48:34.685ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(8655890d-aec5-4d9f-9c1a-bd655965cbb7, 0), (a7af1df2-c076-4588-af77-22c33075ab6c, 0), (d52917d2-815c-4745-8ea7-d1682641cd38, 0)]
72452026-10-29T02:48:34.685ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 364107717 } })
72462026-10-29T02:48:34.687ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 365640578 } })
72472026-10-29T02:48:34.688ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
72482026-10-29T02:48:34.688ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
72492026-10-29T02:48:34.688ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
72502026-10-29T02:48:34.688ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e85e7374-01c0-445b-ba88-f5c597ac7ce2", "content-length": "50", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72512026-10-29T02:48:34.688ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
72522026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d321038-aba5-4137-aa8c-e70563adff77", "content-length": "681", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72532026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
72542026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
72552026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72562026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72572026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab06dea-edae-44fb-808b-330ee8007fb3", "content-length": "734", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72582026-10-29T02:48:34.689ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
72592026-10-29T02:48:34.690ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbfd2a7e-301c-44ab-b307-25bd6fd9c2b1", "content-length": "111", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72602026-10-29T02:48:34.690ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
72612026-10-29T02:48:34.690ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de316945-cfa2-447b-851b-8a376f374ee5", "content-length": "111", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72622026-10-29T02:48:34.690ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
72632026-10-29T02:48:34.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72642026-10-29T02:48:34.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72652026-10-29T02:48:34.691ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0553d650-f77d-4e43-a196-eb7381eb3f08", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72662026-10-29T02:48:34.691ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
72672026-10-29T02:48:34.691ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "438223fb-6d2a-4633-8b86-fe75094f9b81", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72682026-10-29T02:48:34.691ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
72692026-10-29T02:48:34.692ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3795b53e-88ca-4b62-81a4-8c53ef9cb4db", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72702026-10-29T02:48:34.692ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
72712026-10-29T02:48:34.692ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ec646dd-2664-445a-af9c-b4b06bf3d488", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72722026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
72732026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea238d5a-8c01-451a-8a42-67a88255dce6", "content-length": "702", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72742026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
72752026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "442036b2-285c-42a6-b987-7c780846b342", "content-length": "727", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72762026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
72772026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
72782026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "127ed197-9579-4923-9480-dfb517d4b2cc", "content-length": "729", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72792026-10-29T02:48:34.693ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
72802026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdba6d7b-a2fa-401a-8572-71f2852da520", "content-length": "728", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72812026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
72822026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
72832026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "799bd3e9-16d5-4b13-97c1-b699cbb48402", "content-length": "722", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72842026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
72852026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bb9610d-6a16-4fec-a0a5-0071ac02e09f", "content-length": "10", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72862026-10-29T02:48:34.694ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
72872026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2a0f72b-0dcd-430f-8a70-5a52a55c01fe", "content-length": "144", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72882026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
72892026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6528d52-d5a6-4137-be04-e5b4177d202b", "content-length": "147", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72902026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
72912026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72922026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca2a8fae-48e2-415f-8d6e-5504799cf6e7", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72932026-10-29T02:48:34.695ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
72942026-10-29T02:48:34.696ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1454b84-0d0a-40ac-a5b2-e4737aa2bc74", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72952026-10-29T02:48:34.696ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
72962026-10-29T02:48:34.696ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7c14bbb-214b-4b91-b547-25200199c190", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72972026-10-29T02:48:34.696ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
72982026-10-29T02:48:34.697ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d5754cd-23df-46cf-8c13-26b8d054cfd1", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
72992026-10-29T02:48:34.697ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
73002026-10-29T02:48:34.697ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "51967da3-4bd5-4069-a765-9a295de4d50a", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73012026-10-29T02:48:34.697ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
73022026-10-29T02:48:34.698ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "388d9075-67c3-4cda-85b4-24d229af8480", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73032026-10-29T02:48:34.698ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
73042026-10-29T02:48:34.698ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed0fea0c-20b9-4e41-8785-ab34a6b50d9c", "content-length": "702", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73052026-10-29T02:48:34.698ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
73062026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fb8d5cb-77ec-4dda-9883-00df4c01983c", "content-length": "727", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73072026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
73082026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "00d88cce-d3a9-4879-a7cb-40bfe9bb8016", "content-length": "729", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73092026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
73102026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1deafb9b-8fa9-4595-82d7-f6a514e91ff8", "content-length": "728", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73112026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
73122026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "43914503-4f5e-42cc-a746-20732539cf9a", "content-length": "722", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73132026-10-29T02:48:34.699ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
73142026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "74b12f20-e983-47b3-90cd-c0f86e78bd0d", "content-length": "10", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73152026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
73162026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c717d2c-b1f3-4ab5-8d4c-6674fe8ebd41", "content-length": "144", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73172026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
73182026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cd191ea-e07f-4d10-94bb-4b897de0a747", "content-length": "147", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73192026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
73202026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd803ee-c072-4ebe-a5bc-ea2e74066d64", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73212026-10-29T02:48:34.700ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
73222026-10-29T02:48:34.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
73232026-10-29T02:48:34.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73242026-10-29T02:48:34.701ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "89ae9982-bd46-43ed-8dea-ba95b32af62b", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73252026-10-29T02:48:34.701ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
73262026-10-29T02:48:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73272026-10-29T02:48:34.701ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ee5e507-6ab7-43a4-92f1-ccd41a445dae", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73282026-10-29T02:48:34.702ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
73292026-10-29T02:48:34.702ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1f85f3-3d0f-4221-8aef-0a519532ce4f", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73302026-10-29T02:48:34.702ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
73312026-10-29T02:48:34.702ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fd48b4-4261-45fd-865f-8805473d40cb", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73322026-10-29T02:48:34.702ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
73332026-10-29T02:48:34.703ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d372969a-4ae4-42d9-a7b9-9e0e6484a821", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73342026-10-29T02:48:34.703ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
73352026-10-29T02:48:34.703ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "93e8eb4b-94fd-414c-a737-422aa2700324", "content-length": "702", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73362026-10-29T02:48:34.703ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
73372026-10-29T02:48:34.704ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3756b8dc-fec3-4427-9b6e-2ad7f6e276d3", "content-length": "727", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73382026-10-29T02:48:34.704ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
73392026-10-29T02:48:34.704ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebecaf0b-f186-4b1d-83a9-667a6ce8215d", "content-length": "729", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73402026-10-29T02:48:34.704ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
73412026-10-29T02:48:34.704ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dc2fde9-6d88-4d59-8e88-ccbcee8851f7", "content-length": "728", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
73422026-10-29T02:48:34.704ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73432026-10-29T02:48:34.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
73442026-10-29T02:48:34.708ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73452026-10-29T02:48:34.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73462026-10-29T02:48:34.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73472026-10-29T02:48:34.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
73482026-10-29T02:48:34.711ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73492026-10-29T02:48:34.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
73502026-10-29T02:48:34.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73512026-10-29T02:48:34.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73522026-10-29T02:48:34.713ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73532026-10-29T02:48:34.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
73542026-10-29T02:48:34.719ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73552026-10-29T02:48:34.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
73562026-10-29T02:48:34.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73572026-10-29T02:48:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73582026-10-29T02:48:34.722ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
73592026-10-29T02:48:34.722ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
73602026-10-29T02:48:34.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73612026-10-29T02:48:34.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73622026-10-29T02:48:34.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73632026-10-29T02:48:34.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73642026-10-29T02:48:34.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73652026-10-29T02:48:34.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73662026-10-29T02:48:34.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73672026-10-29T02:48:34.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73682026-10-29T02:48:34.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73692026-10-29T02:48:34.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73702026-10-29T02:48:34.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73712026-10-29T02:48:34.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
73722026-10-29T02:48:34.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73732026-10-29T02:48:34.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73742026-10-29T02:48:34.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73752026-10-29T02:48:34.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73762026-10-29T02:48:34.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73772026-10-29T02:48:34.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73782026-10-29T02:48:34.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73792026-10-29T02:48:34.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73802026-10-29T02:48:34.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
73812026-10-29T02:48:34.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73822026-10-29T02:48:34.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73832026-10-29T02:48:34.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73842026-10-29T02:48:34.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73852026-10-29T02:48:34.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
73862026-10-29T02:48:34.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73872026-10-29T02:48:34.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73882026-10-29T02:48:34.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73892026-10-29T02:48:34.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73902026-10-29T02:48:34.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73912026-10-29T02:48:34.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
73922026-10-29T02:48:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
73932026-10-29T02:48:34.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73942026-10-29T02:48:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
73952026-10-29T02:48:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73962026-10-29T02:48:34.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73972026-10-29T02:48:34.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
73982026-10-29T02:48:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
73992026-10-29T02:48:34.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74002026-10-29T02:48:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
74012026-10-29T02:48:34.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
74022026-10-29T02:48:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
74032026-10-29T02:48:34.765ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
74042026-10-29T02:48:34.765ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
74052026-10-29T02:48:34.766ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = b7c146b1-4426-439b-9bf9-1c6ac997e7cc parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
74062026-10-29T02:48:34.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
74072026-10-29T02:48:34.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
74082026-10-29T02:48:34.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
74092026-10-29T02:48:34.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
74102026-10-29T02:48:34.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
74112026-10-29T02:48:34.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74122026-10-29T02:48:34.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
74132026-10-29T02:48:34.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
74142026-10-29T02:48:34.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
74152026-10-29T02:48:34.775ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
74162026-10-29T02:48:34.775ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
74172026-10-29T02:48:34.775ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
74182026-10-29T02:48:34.776ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
74192026-10-29T02:48:34.776ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
74202026-10-29T02:48:34.776ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 1.050170128s iteration = 29 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
74212026-10-29T02:48:34.778ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba410653-27a7-49f3-b336-febb799f4c74", "content-length": "93658", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74222026-10-29T02:48:34.778ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
74232026-10-29T02:48:34.778ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
74242026-10-29T02:48:34.778ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
74252026-10-29T02:48:34.778ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
74262026-10-29T02:48:34.778ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
74272026-10-29T02:48:34.778ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
74282026-10-29T02:48:34.778ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
74292026-10-29T02:48:34.778ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
74302026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6350ace-88f7-4ef6-8502-924a7c264dee", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74312026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "454126b0-2102-43eb-b81c-23b3ea4879b1", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74322026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
74332026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
74342026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dab4a596-e3a4-4db1-8896-7863df09b741", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74352026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fae2331f-7f63-48e4-aac0-6c9a3f6d122a", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74362026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
74372026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
74382026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9578ef29-54da-4407-a665-425aec799fc3", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74392026-10-29T02:48:34.779ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
74402026-10-29T02:48:34.786ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "316d9620-186d-4c72-ae9f-b22d7d37afed", "content-length": "415144", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74412026-10-29T02:48:34.786ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "89ae08eb-e7ef-4fe0-be55-8972d570867a", "content-length": "431045", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74422026-10-29T02:48:34.786ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc88b5b6-fadd-4e95-b569-b74c9640f3f1", "content-length": "419079", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74432026-10-29T02:48:34.788ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "06a71503-40d9-4206-a87c-2da1802812c0", "content-length": "421244", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74442026-10-29T02:48:34.789ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "33c09e63-1272-4a3f-a7b0-0426a7bb16d0", "content-length": "417086", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74452026-10-29T02:48:34.793ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
74462026-10-29T02:48:34.793ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
74472026-10-29T02:48:34.793ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
74482026-10-29T02:48:34.793ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
74492026-10-29T02:48:34.793ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
74502026-10-29T02:48:34.794ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
74512026-10-29T02:48:34.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
74522026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
74532026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
74542026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
74552026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f675d9e-582c-49b6-b450-181cde489c19", "content-length": "253", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74562026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
74572026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
74582026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
74592026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
74602026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
74612026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
74622026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
74632026-10-29T02:48:34.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
74642026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "537f025c-ea49-4457-8d93-ab31d8df96d8", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74652026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4579426-a85e-4bc4-bfcc-a0be52688146", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74662026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf03fb78-da2b-43d0-81ea-98060763f6e5", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74672026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
74682026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
74692026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
74702026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
74712026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
74722026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74732026-10-29T02:48:34.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
74742026-10-29T02:48:34.802ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74752026-10-29T02:48:34.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
74762026-10-29T02:48:34.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
74772026-10-29T02:48:34.805ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
74782026-10-29T02:48:34.805ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74792026-10-29T02:48:34.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
74802026-10-29T02:48:34.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74812026-10-29T02:48:34.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
74822026-10-29T02:48:34.809ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
74832026-10-29T02:48:34.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "99a43c53-86e4-4a59-8fea-aab2785d4981", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
74842026-10-29T02:48:34.809ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
74852026-10-29T02:48:34.809ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = Dns step id = Ensure
74862026-10-29T02:48:34.809ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
74872026-10-29T02:48:34.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
74882026-10-29T02:48:34.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
74892026-10-29T02:48:34.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
74902026-10-29T02:48:34.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
74912026-10-29T02:48:34.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74922026-10-29T02:48:34.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
74932026-10-29T02:48:34.818ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
74942026-10-29T02:48:34.818ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
74952026-10-29T02:48:34.818ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
74962026-10-29T02:48:34.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
74972026-10-29T02:48:34.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
74982026-10-29T02:48:34.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74992026-10-29T02:48:34.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
75002026-10-29T02:48:34.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75012026-10-29T02:48:34.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75022026-10-29T02:48:34.826ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
75032026-10-29T02:48:34.826ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
75042026-10-29T02:48:34.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75052026-10-29T02:48:34.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75062026-10-29T02:48:34.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75072026-10-29T02:48:34.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
75082026-10-29T02:48:34.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75092026-10-29T02:48:34.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75102026-10-29T02:48:34.835ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
75112026-10-29T02:48:34.835ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
75122026-10-29T02:48:34.835ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
75132026-10-29T02:48:34.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75142026-10-29T02:48:34.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75152026-10-29T02:48:34.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75162026-10-29T02:48:34.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75172026-10-29T02:48:34.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75182026-10-29T02:48:34.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
75192026-10-29T02:48:34.843ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
75202026-10-29T02:48:34.843ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
75212026-10-29T02:48:34.843ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
75222026-10-29T02:48:34.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75232026-10-29T02:48:34.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75242026-10-29T02:48:34.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75252026-10-29T02:48:34.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
75262026-10-29T02:48:34.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75272026-10-29T02:48:34.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75282026-10-29T02:48:34.904ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
75292026-10-29T02:48:34.904ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
75302026-10-29T02:48:34.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75312026-10-29T02:48:34.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75322026-10-29T02:48:34.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75332026-10-29T02:48:34.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
75342026-10-29T02:48:34.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75352026-10-29T02:48:34.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75362026-10-29T02:48:34.914ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
75372026-10-29T02:48:34.914ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
75382026-10-29T02:48:34.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75392026-10-29T02:48:34.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75402026-10-29T02:48:34.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75412026-10-29T02:48:34.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
75422026-10-29T02:48:34.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75432026-10-29T02:48:34.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75442026-10-29T02:48:34.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75452026-10-29T02:48:34.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75462026-10-29T02:48:34.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75472026-10-29T02:48:34.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75482026-10-29T02:48:34.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75492026-10-29T02:48:34.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
75502026-10-29T02:48:34.931ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
75512026-10-29T02:48:34.931ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
75522026-10-29T02:48:34.931ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = OmicronZones step id = Cleanup
75532026-10-29T02:48:34.931ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = OmicronZones step id = Cleanup
75542026-10-29T02:48:34.931ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = PhysicalDisks step id = Cleanup
75552026-10-29T02:48:34.931ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = Clickhouse step id = Ensure
75562026-10-29T02:48:34.931ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = Clickhouse step id = Ensure
75572026-10-29T02:48:34.931ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
75582026-10-29T02:48:34.935ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "b2e8cce0-13f8-4077-a295-b2e7b5da1fb7", "date": "Thu, 29 Oct 2026 02:48:34 GMT"} })
75592026-10-29T02:48:34.935ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = SupportBundles step id = Cleanup
75602026-10-29T02:48:34.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75612026-10-29T02:48:34.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75622026-10-29T02:48:34.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75632026-10-29T02:48:34.940ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
75642026-10-29T02:48:34.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75652026-10-29T02:48:34.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75662026-10-29T02:48:34.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75672026-10-29T02:48:34.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75682026-10-29T02:48:34.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75692026-10-29T02:48:34.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
75702026-10-29T02:48:34.959ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = OmicronZones step id = Cleanup
75712026-10-29T02:48:34.959ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
75722026-10-29T02:48:34.959ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
75732026-10-29T02:48:34.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75742026-10-29T02:48:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75752026-10-29T02:48:34.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75762026-10-29T02:48:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
75772026-10-29T02:48:34.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75782026-10-29T02:48:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75792026-10-29T02:48:34.965ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
75802026-10-29T02:48:34.965ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
75812026-10-29T02:48:34.965ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = OmicronZones step id = Cleanup
75822026-10-29T02:48:34.965ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
75832026-10-29T02:48:34.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75842026-10-29T02:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75852026-10-29T02:48:34.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75862026-10-29T02:48:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
75872026-10-29T02:48:34.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75882026-10-29T02:48:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75892026-10-29T02:48:35.069ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
75902026-10-29T02:48:35.069ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = Cockroach step id = Ensure
75912026-10-29T02:48:35.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
75922026-10-29T02:48:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
75932026-10-29T02:48:35.080ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
75942026-10-29T02:48:35.080ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = b0da6cb3-adcd-4897-b7e7-4ba128b0525e step component = MgsUpdates step id = Ensure
75952026-10-29T02:48:35.080ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 32 reason = Dependency
75962026-10-29T02:48:35.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75972026-10-29T02:48:35.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.354126435s iteration = 12 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":3200,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":573716925,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":573716875,"secs":0}},"event_index":1,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":573731485,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":35323304,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":35323254,"secs":0}},"event_index":2,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":609080849,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":246248748,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":246248698,"secs":0}},"event_index":3,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":855349778,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3938282,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3938242,"secs":0}},"event_index":4,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":859314330,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":223715640,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":223715600,"secs":0}},"event_index":5,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":83041310,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":121461005,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":121460965,"secs":0}},"event_index":6,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":204510305,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4771,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":4740,"secs":0}},"event_index":7,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":204527296,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2160,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2131,"secs":0}},"event_index":8,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":204531996,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2770,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":2730,"secs":0}},"event_index":9,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":204536286,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":1570,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":1530,"secs":0}},"event_index":10,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":204538996,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4213557,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":4213527,"secs":0}},"event_index":11,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":208753623,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":24013019,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":24012979,"secs":0}},"event_index":12,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":232774552,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":5987804,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":5987764,"secs":0}},"event_index":13,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":238779617,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":103946300,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":103946250,"secs":0}},"event_index":14,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":342735158,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":10928957,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":10928917,"secs":0}},"event_index":15,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":353677385,"secs":1}},{"data":{"attempt_elapsed":{"nanos":5100,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":5060,"secs":0}},"event_index":16,"execution_id":"b0da6cb3-adcd-4897-b7e7-4ba128b0525e","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":353692776,"secs":1}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
75982026-10-29T02:48:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75992026-10-29T02:48:35.083ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002026-10-29T02:48:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76012026-10-29T02:48:35.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76022026-10-29T02:48:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76032026-10-29T02:48:35.088ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76042026-10-29T02:48:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76052026-10-29T02:48:35.090ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76062026-10-29T02:48:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76072026-10-29T02:48:35.093ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76082026-10-29T02:48:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76092026-10-29T02:48:35.094ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
76102026-10-29T02:48:35.094ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 14.329778ms iteration = 32 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
76112026-10-29T02:48:35.120ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c file = nexus/db-queries/src/db/datastore/inventory.rs:2241
76122026-10-29T02:48:35.120ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c time_started = 2026-10-29 02:48:34.688212 UTC
76132026-10-29T02:48:35.120ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 54 reason = Dependency
76142026-10-29T02:48:35.120ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
76152026-10-29T02:48:35.120ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.39428714s iteration = 12 status = {"collection_id":"f3f7147d-81cd-428f-96a0-2c5770b5a76c","time_done":"2026-10-29 02:48:34.800428 UTC","time_started":"2026-10-29 02:48:34.688212 UTC"}
76162026-10-29T02:48:35.120ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 13 reason = Dependency
76172026-10-29T02:48:35.120ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76182026-10-29T02:48:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
76192026-10-29T02:48:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
76202026-10-29T02:48:35.123ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76212026-10-29T02:48:35.125ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76222026-10-29T02:48:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
76232026-10-29T02:48:35.128ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
76242026-10-29T02:48:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
76252026-10-29T02:48:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
76262026-10-29T02:48:35.128ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76272026-10-29T02:48:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
76282026-10-29T02:48:35.130ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
76292026-10-29T02:48:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
76302026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 38 reason = Dependency
76312026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 80.117755ms iteration = 54 status = {"Loaded":{"collection_id":"f3f7147d-81cd-428f-96a0-2c5770b5a76c","time_loaded":"2026-10-29T02:48:35.120676592Z","time_started":"2026-10-29T02:48:34.688212Z"}}
76322026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 21 reason = Dependency
76332026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 30 reason = Dependency
76342026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76352026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 28 reason = Dependency
76362026-10-29T02:48:35.200ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
76372026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76382026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
76392026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 27 reason = Dependency
76402026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 18.65\u{b5}s iteration = 28 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
76412026-10-29T02:48:35.200ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
76422026-10-29T02:48:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76432026-10-29T02:48:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76442026-10-29T02:48:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
76452026-10-29T02:48:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
76462026-10-29T02:48:35.203ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76472026-10-29T02:48:35.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482026-10-29T02:48:35.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492026-10-29T02:48:35.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76502026-10-29T02:48:35.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
76512026-10-29T02:48:35.208ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
76522026-10-29T02:48:35.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
76532026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76542026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76552026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
76562026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76572026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76582026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76592026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
76602026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
76612026-10-29T02:48:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
76622026-10-29T02:48:35.210ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632026-10-29T02:48:35.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76642026-10-29T02:48:35.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76652026-10-29T02:48:35.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76662026-10-29T02:48:35.212ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(8655890d-aec5-4d9f-9c1a-bd655965cbb7, 0), (a7af1df2-c076-4588-af77-22c33075ab6c, 0), (d52917d2-815c-4745-8ea7-d1682641cd38, 0), (9ab994a2-5858-4094-8c58-f5965918dab7, 0)] collection_id = 8655890d-aec5-4d9f-9c1a-bd655965cbb7
76672026-10-29T02:48:35.212ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76682026-10-29T02:48:35.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76692026-10-29T02:48:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
76702026-10-29T02:48:35.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
76712026-10-29T02:48:35.213ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
76722026-10-29T02:48:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
76732026-10-29T02:48:35.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742026-10-29T02:48:35.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
76752026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
76762026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
76772026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
76782026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76792026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76802026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76812026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76822026-10-29T02:48:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76832026-10-29T02:48:35.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
76842026-10-29T02:48:35.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
76852026-10-29T02:48:35.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76862026-10-29T02:48:35.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76872026-10-29T02:48:35.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76882026-10-29T02:48:35.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
76892026-10-29T02:48:35.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
76902026-10-29T02:48:35.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
76912026-10-29T02:48:35.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76922026-10-29T02:48:35.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932026-10-29T02:48:35.230ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
76942026-10-29T02:48:35.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76952026-10-29T02:48:35.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76962026-10-29T02:48:35.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76972026-10-29T02:48:35.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76982026-10-29T02:48:35.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
76992026-10-29T02:48:35.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77002026-10-29T02:48:35.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77012026-10-29T02:48:35.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77022026-10-29T02:48:35.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77032026-10-29T02:48:35.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77042026-10-29T02:48:35.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77052026-10-29T02:48:35.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77062026-10-29T02:48:35.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77072026-10-29T02:48:35.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77082026-10-29T02:48:35.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77092026-10-29T02:48:35.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77102026-10-29T02:48:35.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77112026-10-29T02:48:35.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77122026-10-29T02:48:35.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77132026-10-29T02:48:35.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77142026-10-29T02:48:35.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77152026-10-29T02:48:35.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77162026-10-29T02:48:35.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77172026-10-29T02:48:35.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77182026-10-29T02:48:35.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77192026-10-29T02:48:35.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77202026-10-29T02:48:35.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77212026-10-29T02:48:35.251ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 50.216794ms iteration = 38 status = {"disks_added":0,"errors":[]}
77222026-10-29T02:48:35.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77232026-10-29T02:48:35.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77242026-10-29T02:48:35.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77252026-10-29T02:48:35.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77262026-10-29T02:48:35.257ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
77272026-10-29T02:48:35.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77282026-10-29T02:48:35.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77292026-10-29T02:48:35.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77302026-10-29T02:48:35.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77312026-10-29T02:48:35.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77322026-10-29T02:48:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77332026-10-29T02:48:35.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342026-10-29T02:48:35.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77352026-10-29T02:48:35.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77362026-10-29T02:48:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77372026-10-29T02:48:35.269ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
77382026-10-29T02:48:35.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
77392026-10-29T02:48:35.269ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
77402026-10-29T02:48:35.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77412026-10-29T02:48:35.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77422026-10-29T02:48:35.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77432026-10-29T02:48:35.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77442026-10-29T02:48:35.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77452026-10-29T02:48:35.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77462026-10-29T02:48:35.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77472026-10-29T02:48:35.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77482026-10-29T02:48:35.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77492026-10-29T02:48:35.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77502026-10-29T02:48:35.284ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
77512026-10-29T02:48:35.284ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 20 reason = Dependency
77522026-10-29T02:48:35.284ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
77532026-10-29T02:48:35.284ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 83.70331ms iteration = 21 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"f3f7147d-81cd-428f-96a0-2c5770b5a76c","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
77542026-10-29T02:48:35.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
77552026-10-29T02:48:35.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77562026-10-29T02:48:35.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77572026-10-29T02:48:35.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77582026-10-29T02:48:35.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
77592026-10-29T02:48:35.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77602026-10-29T02:48:35.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77612026-10-29T02:48:35.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77622026-10-29T02:48:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77632026-10-29T02:48:35.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77642026-10-29T02:48:35.313ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 8655890d-aec5-4d9f-9c1a-bd655965cbb7 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
77652026-10-29T02:48:35.313ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77662026-10-29T02:48:35.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
77672026-10-29T02:48:35.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77682026-10-29T02:48:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
77692026-10-29T02:48:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77702026-10-29T02:48:35.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77712026-10-29T02:48:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77722026-10-29T02:48:35.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77732026-10-29T02:48:35.322ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(a7af1df2-c076-4588-af77-22c33075ab6c, 0), (d52917d2-815c-4745-8ea7-d1682641cd38, 0), (9ab994a2-5858-4094-8c58-f5965918dab7, 0), (979a4b22-0c7a-4b3e-89db-7cf104733c2c, 0)] collection_id = a7af1df2-c076-4588-af77-22c33075ab6c
77742026-10-29T02:48:35.322ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77752026-10-29T02:48:35.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
77762026-10-29T02:48:35.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
77772026-10-29T02:48:35.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77782026-10-29T02:48:35.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77792026-10-29T02:48:35.334ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
77802026-10-29T02:48:35.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
77812026-10-29T02:48:35.335ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
77822026-10-29T02:48:35.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
77832026-10-29T02:48:35.338ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77842026-10-29T02:48:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
77852026-10-29T02:48:35.340ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
77862026-10-29T02:48:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
77872026-10-29T02:48:35.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77882026-10-29T02:48:35.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77892026-10-29T02:48:35.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902026-10-29T02:48:35.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
77912026-10-29T02:48:35.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77922026-10-29T02:48:35.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77932026-10-29T02:48:35.394ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
77942026-10-29T02:48:35.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
77952026-10-29T02:48:35.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
77962026-10-29T02:48:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
77972026-10-29T02:48:35.397ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77982026-10-29T02:48:35.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77992026-10-29T02:48:35.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
78002026-10-29T02:48:35.400ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78012026-10-29T02:48:35.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78022026-10-29T02:48:35.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
78032026-10-29T02:48:35.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78042026-10-29T02:48:35.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78052026-10-29T02:48:35.403ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78062026-10-29T02:48:35.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78072026-10-29T02:48:35.405ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78082026-10-29T02:48:35.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78092026-10-29T02:48:35.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78102026-10-29T02:48:35.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78112026-10-29T02:48:35.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
78122026-10-29T02:48:35.408ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78132026-10-29T02:48:35.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78142026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
78152026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78162026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
78172026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 127.110872ms iteration = 20 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
78182026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 31 reason = Dependency
78192026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
78202026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78212026-10-29T02:48:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
78222026-10-29T02:48:35.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78232026-10-29T02:48:35.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78242026-10-29T02:48:35.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78252026-10-29T02:48:35.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78262026-10-29T02:48:35.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78272026-10-29T02:48:35.422ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = a7af1df2-c076-4588-af77-22c33075ab6c file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
78282026-10-29T02:48:35.422ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78292026-10-29T02:48:35.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
78302026-10-29T02:48:35.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
78312026-10-29T02:48:35.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78322026-10-29T02:48:35.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78332026-10-29T02:48:35.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78342026-10-29T02:48:35.428ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(d52917d2-815c-4745-8ea7-d1682641cd38, 0), (9ab994a2-5858-4094-8c58-f5965918dab7, 0), (979a4b22-0c7a-4b3e-89db-7cf104733c2c, 0), (f3f7147d-81cd-428f-96a0-2c5770b5a76c, 0)] collection_id = d52917d2-815c-4745-8ea7-d1682641cd38
78352026-10-29T02:48:35.428ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78362026-10-29T02:48:35.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78372026-10-29T02:48:35.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
78382026-10-29T02:48:35.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78392026-10-29T02:48:35.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
78402026-10-29T02:48:35.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78412026-10-29T02:48:35.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78422026-10-29T02:48:35.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78432026-10-29T02:48:35.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78442026-10-29T02:48:35.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78452026-10-29T02:48:35.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
78462026-10-29T02:48:35.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78472026-10-29T02:48:35.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78482026-10-29T02:48:35.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78492026-10-29T02:48:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78502026-10-29T02:48:35.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78512026-10-29T02:48:35.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
78522026-10-29T02:48:35.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78532026-10-29T02:48:35.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78542026-10-29T02:48:35.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78552026-10-29T02:48:35.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78562026-10-29T02:48:35.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78572026-10-29T02:48:35.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
78582026-10-29T02:48:35.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78592026-10-29T02:48:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78602026-10-29T02:48:35.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78612026-10-29T02:48:35.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78622026-10-29T02:48:35.468ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78632026-10-29T02:48:35.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78642026-10-29T02:48:35.471ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652026-10-29T02:48:35.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78662026-10-29T02:48:35.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
78672026-10-29T02:48:35.474ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78682026-10-29T02:48:35.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78692026-10-29T02:48:35.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
78702026-10-29T02:48:35.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
78712026-10-29T02:48:35.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
78722026-10-29T02:48:35.478ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
78732026-10-29T02:48:35.478ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78742026-10-29T02:48:35.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78752026-10-29T02:48:35.482ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78762026-10-29T02:48:35.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
78772026-10-29T02:48:35.484ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
78782026-10-29T02:48:35.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
78792026-10-29T02:48:35.488ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
78802026-10-29T02:48:35.488ZINFOnexus (BackgroundTasks): building sitrep 23a62ef4-1a43-4b66-a632-a8b6abeb92fe (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 23a62ef4-1a43-4b66-a632-a8b6abeb92fe (sitrep)
78812026-10-29T02:48:35.488ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = f3f7147d-81cd-428f-96a0-2c5770b5a76c parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
78822026-10-29T02:48:35.488ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 287.306852ms iteration = 27 status = {"inv_collection_id":"f3f7147d-81cd-428f-96a0-2c5770b5a76c","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:48:35.488100119Z","outcome":"Unchanged","start_time":"2026-10-29T02:48:35.488062228Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
78832026-10-29T02:48:35.520ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = d52917d2-815c-4745-8ea7-d1682641cd38 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
78842026-10-29T02:48:35.521ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78852026-10-29T02:48:35.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
78862026-10-29T02:48:35.525ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(9ab994a2-5858-4094-8c58-f5965918dab7, 0), (979a4b22-0c7a-4b3e-89db-7cf104733c2c, 0), (f3f7147d-81cd-428f-96a0-2c5770b5a76c, 0)]
78872026-10-29T02:48:35.525ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1277, tv_nsec: 203744049 } })
78882026-10-29T02:48:35.526ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1277, tv_nsec: 204826171 } })
78892026-10-29T02:48:35.527ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
78902026-10-29T02:48:35.527ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
78912026-10-29T02:48:35.527ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
78922026-10-29T02:48:35.527ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f4ada9e-110d-49b5-99ce-f96a4bd99060", "content-length": "50", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
78932026-10-29T02:48:35.527ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
78942026-10-29T02:48:35.528ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "517f3959-b5ae-4917-b156-0a5ba0256bca", "content-length": "681", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
78952026-10-29T02:48:35.528ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
78962026-10-29T02:48:35.529ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "488d94d6-2ffd-4f1b-82bb-955e9e23e58e", "content-length": "734", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
78972026-10-29T02:48:35.529ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
78982026-10-29T02:48:35.529ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b511428f-d9f7-4718-b06d-654029956076", "content-length": "111", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
78992026-10-29T02:48:35.529ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
79002026-10-29T02:48:35.530ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc14bf71-a3b5-46b4-8724-3ee86209dd87", "content-length": "111", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79012026-10-29T02:48:35.530ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
79022026-10-29T02:48:35.531ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a5f83a1-b53c-457a-be06-fc087aa3449e", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79032026-10-29T02:48:35.531ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
79042026-10-29T02:48:35.532ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "71bde5fa-80b4-4fd0-b2a1-7acd412f63dd", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79052026-10-29T02:48:35.532ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
79062026-10-29T02:48:35.532ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee9a7162-e590-4394-ba05-1f3100950e7e", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79072026-10-29T02:48:35.532ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
79082026-10-29T02:48:35.533ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b3168c3-f1e9-4fc7-9f91-fe006020ead9", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79092026-10-29T02:48:35.533ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
79102026-10-29T02:48:35.533ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec52b8ba-3dfd-4c57-873e-463308c347ee", "content-length": "702", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79112026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79122026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e0429f4-1a18-4075-97ae-fd3a4ae4de6b", "content-length": "727", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79132026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79142026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d3c4a9e-6d23-4dc8-a07e-4e90d3560f27", "content-length": "729", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79152026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79162026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4d554a4-0495-41a8-afe2-deab9f63d64d", "content-length": "728", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79172026-10-29T02:48:35.534ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
79182026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eabecaa5-763d-4a97-a985-da67d5ccac3a", "content-length": "722", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79192026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
79202026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "7be15992-00fb-40b9-a08b-a1296c51b75d", "content-length": "10", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79212026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
79222026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce6e85fa-89e6-49c2-a4d3-b91bec9ad6f7", "content-length": "144", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79232026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
79242026-10-29T02:48:35.535ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fa8251d-8c39-4e52-9cd2-fd2113bc5516", "content-length": "147", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79252026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
79262026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
79272026-10-29T02:48:35.536ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
79282026-10-29T02:48:35.536ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 93c0e2ff-0425-482c-b9b4-ccf472fb8cc6 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
79292026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
79302026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "decb977b-6323-4b2b-a3ed-0d3c1cb4cc6c", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79312026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
79322026-10-29T02:48:35.536ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
79332026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 124.917266ms iteration = 31 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
79342026-10-29T02:48:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
79352026-10-29T02:48:35.537ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "715d4a66-9e05-4c3b-b8b3-e5481cb7d7fe", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79362026-10-29T02:48:35.537ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
79372026-10-29T02:48:35.537ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6645168c-b8e6-4fb0-bd42-f7a112d466a4", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79382026-10-29T02:48:35.537ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
79392026-10-29T02:48:35.538ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd7b41ef-c1f3-4e79-8d61-8d857b1894ac", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79402026-10-29T02:48:35.538ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
79412026-10-29T02:48:35.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422026-10-29T02:48:35.538ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9b53d96-ef17-4dbc-bf24-976efc43b7a9", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79432026-10-29T02:48:35.538ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
79442026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38d4a4a6-bf3f-4860-bd7d-e74a1a30562a", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79452026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
79462026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "135d9d53-9c67-475f-a543-d59977074095", "content-length": "702", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79472026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79482026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "375470e8-4d9c-43e2-8134-592dc47fb8e4", "content-length": "727", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79492026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79502026-10-29T02:48:35.539ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1685eb28-1467-4734-968a-6b06553e65c1", "content-length": "729", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79512026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79522026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e7c49f6-41bb-43cc-b8e5-40372aa456df", "content-length": "728", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79532026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
79542026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1746b4-47a0-44e4-9bd4-1eb1fea0bf6a", "content-length": "722", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79552026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
79562026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdccb1d8-84a2-433c-8534-127c9a390679", "content-length": "10", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79572026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
79582026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbfcbd39-c8d8-463a-b382-a1ba5371d59f", "content-length": "144", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79592026-10-29T02:48:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
79602026-10-29T02:48:35.541ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "498b37e9-80a3-4e9f-bed8-25e6ce4a7296", "content-length": "147", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79612026-10-29T02:48:35.541ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
79622026-10-29T02:48:35.541ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4318a55d-afdb-41af-82c2-0c9dce8e4a86", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79632026-10-29T02:48:35.541ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
79642026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4793aca-821e-43c4-950c-a0ecf758b818", "content-length": "109", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79652026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
79662026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
79672026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
79682026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
79692026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd62ddd-de29-4523-9113-02d309c88566", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79702026-10-29T02:48:35.542ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
79712026-10-29T02:48:35.543ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "27054041-ecc6-4a5c-8f85-99ae2fdb1856", "content-length": "163", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79722026-10-29T02:48:35.543ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
79732026-10-29T02:48:35.543ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6505eb6-17d9-4377-82d5-6327b03f99c7", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79742026-10-29T02:48:35.543ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
79752026-10-29T02:48:35.544ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c930df4-248e-4e40-8b0d-68b8693537ad", "content-length": "166", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79762026-10-29T02:48:35.544ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
79772026-10-29T02:48:35.544ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7f0ae87-e651-4b4d-9788-c928a13bf491", "content-length": "702", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79782026-10-29T02:48:35.544ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
79792026-10-29T02:48:35.544ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "434149d4-81f0-4ac7-ac99-14b62b8d1d60", "content-length": "727", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79802026-10-29T02:48:35.544ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
79812026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "76c7b4fb-47a0-4f41-b1fa-aed57e134fb0", "content-length": "729", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79822026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
79832026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "30ffa610-1a24-43c7-8515-550864b10864", "content-length": "728", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
79842026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79852026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
79862026-10-29T02:48:35.545ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
79872026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 344.832097ms iteration = 30 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
79882026-10-29T02:48:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
79892026-10-29T02:48:35.547ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79902026-10-29T02:48:35.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79912026-10-29T02:48:35.550ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79922026-10-29T02:48:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
79932026-10-29T02:48:35.552ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79942026-10-29T02:48:35.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79952026-10-29T02:48:35.555ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79962026-10-29T02:48:35.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
79972026-10-29T02:48:35.558ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
79982026-10-29T02:48:35.558ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
79992026-10-29T02:48:35.613ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f00d94-a162-4d57-b097-f6fd46e35951", "content-length": "93658", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80002026-10-29T02:48:35.614ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80012026-10-29T02:48:35.614ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80022026-10-29T02:48:35.614ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
80032026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
80042026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
80052026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
80062026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
80072026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
80082026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0dbcd2f-99d1-42eb-acf5-db04ef422753", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80092026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13da37eb-43b4-43c8-abac-d8e8668839fe", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80102026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4049c153-1c4a-4f6d-a7c9-ed3844182574", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80112026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
80122026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
80132026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
80142026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "099d1ac8-6c33-4bce-b408-636255dc643f", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80152026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
80162026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc3b22a5-61e1-46d4-aee9-8a9957be4291", "content-length": "64", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80172026-10-29T02:48:35.614ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
80182026-10-29T02:48:35.621ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "246188b2-bbbc-47e0-a554-532bf51dd5d8", "content-length": "419196", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80192026-10-29T02:48:35.622ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcf092d6-ebb3-47d8-9e74-2cc42344e407", "content-length": "421578", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80202026-10-29T02:48:35.625ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dee8638-5d36-410b-a15a-333cd6005bb2", "content-length": "415206", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80212026-10-29T02:48:35.627ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa7fe18d-617a-4056-8cb9-5d6970e2fdac", "content-length": "431165", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80222026-10-29T02:48:35.628ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "3942014a-90ab-4d5b-b05d-01930b5febe1", "content-length": "417352", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80232026-10-29T02:48:35.631ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
80242026-10-29T02:48:35.631ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
80252026-10-29T02:48:35.631ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
80262026-10-29T02:48:35.631ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
80272026-10-29T02:48:35.631ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
80282026-10-29T02:48:35.631ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
80292026-10-29T02:48:35.631ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
80302026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "40fccdbb-718b-4b0e-9b77-289d097a9e4e", "content-length": "254", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80312026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
80322026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
80332026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
80342026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
80352026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
80362026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
80372026-10-29T02:48:35.636ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
80382026-10-29T02:48:35.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1d7d5c3-5e2d-4ed9-99da-d8236c3785d2", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80392026-10-29T02:48:35.637ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
80402026-10-29T02:48:35.637ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "713a1ccd-939d-466c-a7bb-f7afcd28e021", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80412026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06506a00-280d-460c-a972-8fd4f3eaf15c", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:48:35 GMT"} })
80422026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
80432026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
80442026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
80452026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
80462026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80472026-10-29T02:48:35.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
80482026-10-29T02:48:35.641ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80492026-10-29T02:48:35.644ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
80502026-10-29T02:48:35.644ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80512026-10-29T02:48:35.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
80522026-10-29T02:48:35.767ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 574dd761-49fc-4f6e-8935-f6a5c6b88826 file = nexus/db-queries/src/db/datastore/inventory.rs:2241
80532026-10-29T02:48:35.767ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 574dd761-49fc-4f6e-8935-f6a5c6b88826 time_started = 2026-10-29 02:48:35.527349 UTC
80542026-10-29T02:48:35.767ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 55 reason = Dependency
80552026-10-29T02:48:35.767ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
80562026-10-29T02:48:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 646.976028ms iteration = 13 status = {"collection_id":"574dd761-49fc-4f6e-8935-f6a5c6b88826","time_done":"2026-10-29 02:48:35.638139 UTC","time_started":"2026-10-29 02:48:35.527349 UTC"}
80572026-10-29T02:48:35.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
80582026-10-29T02:48:35.769ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80592026-10-29T02:48:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
80602026-10-29T02:48:35.773ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
80612026-10-29T02:48:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
80622026-10-29T02:48:35.864ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
80632026-10-29T02:48:35.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
80642026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 156.711097ms iteration = 55 status = {"Loaded":{"collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","time_loaded":"2026-10-29T02:48:35.767677910Z","time_started":"2026-10-29T02:48:35.619367Z"}}
80652026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 31 reason = Dependency
80662026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 22 reason = Dependency
80672026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 39 reason = Dependency
80682026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
80692026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 28 reason = Dependency
80702026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
80712026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80722026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 29 reason = Dependency
80732026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
80742026-10-29T02:48:35.924ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
80752026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 35.901\u{b5}s iteration = 29 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
80762026-10-29T02:48:35.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
80772026-10-29T02:48:35.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80782026-10-29T02:48:35.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
80792026-10-29T02:48:35.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
80802026-10-29T02:48:35.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80812026-10-29T02:48:35.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80822026-10-29T02:48:35.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80832026-10-29T02:48:35.927ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80842026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
80852026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
80862026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
80872026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
80882026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
80892026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
80902026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
80912026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
80922026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80932026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80942026-10-29T02:48:35.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
80952026-10-29T02:48:35.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80962026-10-29T02:48:35.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80972026-10-29T02:48:35.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80982026-10-29T02:48:35.936ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80992026-10-29T02:48:35.936ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81002026-10-29T02:48:35.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81012026-10-29T02:48:35.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81022026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
81032026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
81042026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
81052026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
81062026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81072026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81082026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81092026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81102026-10-29T02:48:35.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81112026-10-29T02:48:35.942ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81122026-10-29T02:48:35.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81132026-10-29T02:48:35.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81142026-10-29T02:48:35.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81152026-10-29T02:48:35.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81162026-10-29T02:48:35.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
81172026-10-29T02:48:35.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
81182026-10-29T02:48:35.944ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81192026-10-29T02:48:35.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81202026-10-29T02:48:35.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81212026-10-29T02:48:35.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81222026-10-29T02:48:35.946ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81232026-10-29T02:48:35.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81242026-10-29T02:48:35.947ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81252026-10-29T02:48:35.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81262026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81272026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81282026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81292026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
81302026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
81312026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
81322026-10-29T02:48:35.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81332026-10-29T02:48:35.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81342026-10-29T02:48:35.949ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81352026-10-29T02:48:35.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81362026-10-29T02:48:35.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81372026-10-29T02:48:35.951ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81382026-10-29T02:48:35.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81392026-10-29T02:48:35.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
81402026-10-29T02:48:35.953ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81412026-10-29T02:48:35.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81422026-10-29T02:48:35.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81432026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81442026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81452026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
81462026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
81472026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81482026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
81492026-10-29T02:48:35.955ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81502026-10-29T02:48:35.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81512026-10-29T02:48:35.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522026-10-29T02:48:35.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81532026-10-29T02:48:35.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81542026-10-29T02:48:35.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81552026-10-29T02:48:35.957ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81562026-10-29T02:48:35.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81572026-10-29T02:48:35.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81582026-10-29T02:48:35.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
81592026-10-29T02:48:35.961ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81602026-10-29T02:48:35.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81612026-10-29T02:48:35.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81622026-10-29T02:48:35.963ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 38.660893ms iteration = 39 status = {"disks_added":0,"errors":[]}
81632026-10-29T02:48:35.964ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81642026-10-29T02:48:35.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81652026-10-29T02:48:35.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81662026-10-29T02:48:35.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81672026-10-29T02:48:35.966ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81682026-10-29T02:48:35.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81692026-10-29T02:48:35.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
81702026-10-29T02:48:35.970ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
81712026-10-29T02:48:35.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
81722026-10-29T02:48:35.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81732026-10-29T02:48:35.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81742026-10-29T02:48:35.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81752026-10-29T02:48:35.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81762026-10-29T02:48:35.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81772026-10-29T02:48:35.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81782026-10-29T02:48:35.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81792026-10-29T02:48:35.983ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
81802026-10-29T02:48:35.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81812026-10-29T02:48:35.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81822026-10-29T02:48:35.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81832026-10-29T02:48:35.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81842026-10-29T02:48:35.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81852026-10-29T02:48:35.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81862026-10-29T02:48:35.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81872026-10-29T02:48:35.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81882026-10-29T02:48:35.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81892026-10-29T02:48:35.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81902026-10-29T02:48:36.000ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
81912026-10-29T02:48:36.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81922026-10-29T02:48:36.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81932026-10-29T02:48:36.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81942026-10-29T02:48:36.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81952026-10-29T02:48:36.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81962026-10-29T02:48:36.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81972026-10-29T02:48:36.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81982026-10-29T02:48:36.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81992026-10-29T02:48:36.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82002026-10-29T02:48:36.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82012026-10-29T02:48:36.015ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
82022026-10-29T02:48:36.015ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 21 reason = Dependency
82032026-10-29T02:48:36.015ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
82042026-10-29T02:48:36.015ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 91.40191ms iteration = 22 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
82052026-10-29T02:48:36.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
82062026-10-29T02:48:36.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82072026-10-29T02:48:36.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82082026-10-29T02:48:36.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82092026-10-29T02:48:36.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
82102026-10-29T02:48:36.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82112026-10-29T02:48:36.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82122026-10-29T02:48:36.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82132026-10-29T02:48:36.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82142026-10-29T02:48:36.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82152026-10-29T02:48:36.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
82162026-10-29T02:48:36.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82172026-10-29T02:48:36.049ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
82182026-10-29T02:48:36.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82192026-10-29T02:48:36.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
82202026-10-29T02:48:36.052ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82212026-10-29T02:48:36.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82222026-10-29T02:48:36.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82232026-10-29T02:48:36.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
82242026-10-29T02:48:36.055ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
82252026-10-29T02:48:36.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
82262026-10-29T02:48:36.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82272026-10-29T02:48:36.058ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
82282026-10-29T02:48:36.058ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
82292026-10-29T02:48:36.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
82302026-10-29T02:48:36.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
82312026-10-29T02:48:36.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82322026-10-29T02:48:36.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82332026-10-29T02:48:36.060ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82342026-10-29T02:48:36.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82352026-10-29T02:48:36.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
82362026-10-29T02:48:36.064ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
82372026-10-29T02:48:36.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82382026-10-29T02:48:36.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
82392026-10-29T02:48:36.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82402026-10-29T02:48:36.068ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
82412026-10-29T02:48:36.068ZINFOnexus (BackgroundTasks): building sitrep 48157534-a4ca-4744-ab5f-8db0462a4305 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 48157534-a4ca-4744-ab5f-8db0462a4305 (sitrep)
82422026-10-29T02:48:36.068ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = fab426b7-5900-492d-ac33-1daa90da0830 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
82432026-10-29T02:48:36.068ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 143.957132ms iteration = 28 status = {"inv_collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:48:36.068344079Z","outcome":"Unchanged","start_time":"2026-10-29T02:48:36.068316069Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
82442026-10-29T02:48:36.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
82452026-10-29T02:48:36.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82462026-10-29T02:48:36.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82472026-10-29T02:48:36.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82482026-10-29T02:48:36.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82492026-10-29T02:48:36.076ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
82502026-10-29T02:48:36.076ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 60.777203ms iteration = 21 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
82512026-10-29T02:48:36.076ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 32 reason = Dependency
82522026-10-29T02:48:36.076ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
82532026-10-29T02:48:36.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
82542026-10-29T02:48:36.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82552026-10-29T02:48:36.080ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
82562026-10-29T02:48:36.080ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 3.961473ms iteration = 32 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
82572026-10-29T02:48:36.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
82582026-10-29T02:48:36.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82592026-10-29T02:48:36.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82602026-10-29T02:48:36.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82612026-10-29T02:48:36.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82622026-10-29T02:48:36.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82632026-10-29T02:48:36.152ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
82642026-10-29T02:48:36.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82652026-10-29T02:48:36.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82662026-10-29T02:48:36.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82672026-10-29T02:48:36.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82682026-10-29T02:48:36.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82692026-10-29T02:48:36.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82702026-10-29T02:48:36.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82712026-10-29T02:48:36.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
82722026-10-29T02:48:36.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82732026-10-29T02:48:36.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82742026-10-29T02:48:36.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82752026-10-29T02:48:36.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82762026-10-29T02:48:36.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82772026-10-29T02:48:36.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
82782026-10-29T02:48:36.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82792026-10-29T02:48:36.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82802026-10-29T02:48:36.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82812026-10-29T02:48:36.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82822026-10-29T02:48:36.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82832026-10-29T02:48:36.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
82842026-10-29T02:48:36.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82852026-10-29T02:48:36.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82862026-10-29T02:48:36.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82872026-10-29T02:48:36.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82882026-10-29T02:48:36.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82892026-10-29T02:48:36.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
82902026-10-29T02:48:36.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82912026-10-29T02:48:36.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82922026-10-29T02:48:36.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82932026-10-29T02:48:36.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82942026-10-29T02:48:36.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82952026-10-29T02:48:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
82962026-10-29T02:48:36.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82972026-10-29T02:48:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
82982026-10-29T02:48:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
82992026-10-29T02:48:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
83002026-10-29T02:48:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012026-10-29T02:48:36.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
83022026-10-29T02:48:36.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
83032026-10-29T02:48:36.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
83042026-10-29T02:48:36.293ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
83052026-10-29T02:48:36.293ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
83062026-10-29T02:48:36.293ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 5e2fe050-a542-49e0-b2d4-656788bd7155 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
83072026-10-29T02:48:36.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
83082026-10-29T02:48:36.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
83092026-10-29T02:48:36.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83102026-10-29T02:48:36.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
83112026-10-29T02:48:36.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
83122026-10-29T02:48:36.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
83132026-10-29T02:48:36.306ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
83142026-10-29T02:48:36.306ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
83152026-10-29T02:48:36.306ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 381.882438ms iteration = 31 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
83162026-10-29T02:48:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 122 reason = Timeout
83172026-10-29T02:48:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83182026-10-29T02:48:38.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
83192026-10-29T02:48:38.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202026-10-29T02:48:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
83212026-10-29T02:48:38.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83222026-10-29T02:48:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
83232026-10-29T02:48:38.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
83242026-10-29T02:48:38.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.973447ms iteration = 122 status = {"config_updated":false}
83252026-10-29T02:48:40.620ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 131 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = a106dc8f-ab4f-4584-85ec-6ee4a5523e03 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
83262026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 123 reason = Timeout
83272026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83282026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
83292026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
83302026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83312026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83322026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
83332026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
83342026-10-29T02:48:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83352026-10-29T02:48:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83362026-10-29T02:48:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372026-10-29T02:48:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83382026-10-29T02:48:43.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83392026-10-29T02:48:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
83402026-10-29T02:48:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
83412026-10-29T02:48:43.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83422026-10-29T02:48:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
83432026-10-29T02:48:43.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83442026-10-29T02:48:43.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
83452026-10-29T02:48:43.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.746583ms iteration = 123 status = {"config_updated":false}
83462026-10-29T02:48:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
83472026-10-29T02:48:43.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83482026-10-29T02:48:43.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
83492026-10-29T02:48:43.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83502026-10-29T02:48:43.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
83512026-10-29T02:48:43.761ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
83522026-10-29T02:48:43.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.152211ms iteration = 62 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
83532026-10-29T02:48:43.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83542026-10-29T02:48:43.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83552026-10-29T02:48:43.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.894133ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83562026-10-29T02:48:48.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 124 reason = Timeout
83572026-10-29T02:48:48.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 42 reason = Timeout
83582026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
83592026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83602026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 44 reason = Timeout
83612026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 56 reason = Timeout
83622026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
83632026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
83642026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
83652026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
83662026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
83672026-10-29T02:48:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
83682026-10-29T02:48:48.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83692026-10-29T02:48:48.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83702026-10-29T02:48:48.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83712026-10-29T02:48:48.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83722026-10-29T02:48:48.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
83732026-10-29T02:48:48.732ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
83742026-10-29T02:48:48.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
83752026-10-29T02:48:48.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
83762026-10-29T02:48:48.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
83772026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
83782026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
83792026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
83802026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
83812026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83822026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
83832026-10-29T02:48:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
83842026-10-29T02:48:48.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
83852026-10-29T02:48:48.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.08776ms iteration = 44 status = {"Loaded":{"time_loaded":"2026-10-29T02:48:48.725970248Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
83862026-10-29T02:48:48.735ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
83872026-10-29T02:48:48.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 9.326284ms iteration = 42 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
83882026-10-29T02:48:48.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = fab426b7-5900-492d-ac33-1daa90da0830 original_time_started = 2026-10-29 02:48:35.619367 UTC
83892026-10-29T02:48:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.703303ms iteration = 56 status = {"Loaded":{"collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","time_loaded":"2026-10-29T02:48:48.725991448Z","time_started":"2026-10-29T02:48:35.619367Z"}}
83902026-10-29T02:48:48.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
83912026-10-29T02:48:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.987449ms iteration = 124 status = {"config_updated":false}
83922026-10-29T02:48:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 181 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = b9be0898-08c4-4e98-8793-6798a0e7c5ec response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
83932026-10-29T02:48:53.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 125 reason = Timeout
83942026-10-29T02:48:53.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
83952026-10-29T02:48:53.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
83962026-10-29T02:48:53.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
83972026-10-29T02:48:53.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83982026-10-29T02:48:53.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83992026-10-29T02:48:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
84002026-10-29T02:48:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
84012026-10-29T02:48:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84022026-10-29T02:48:53.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84032026-10-29T02:48:53.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84042026-10-29T02:48:53.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84052026-10-29T02:48:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84062026-10-29T02:48:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
84072026-10-29T02:48:53.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
84082026-10-29T02:48:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84092026-10-29T02:48:53.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84102026-10-29T02:48:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
84112026-10-29T02:48:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
84122026-10-29T02:48:53.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
84132026-10-29T02:48:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.1348ms iteration = 125 status = {"config_updated":false}
84142026-10-29T02:48:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84152026-10-29T02:48:53.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
84162026-10-29T02:48:53.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84172026-10-29T02:48:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
84182026-10-29T02:48:53.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84192026-10-29T02:48:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
84202026-10-29T02:48:53.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
84212026-10-29T02:48:53.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.135078ms iteration = 63 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
84222026-10-29T02:48:53.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.229401ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84232026-10-29T02:48:58.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 126 reason = Timeout
84242026-10-29T02:48:58.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
84252026-10-29T02:48:58.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
84262026-10-29T02:48:58.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84272026-10-29T02:48:58.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
84282026-10-29T02:48:58.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
84292026-10-29T02:48:58.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
84302026-10-29T02:48:58.733ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
84312026-10-29T02:48:58.733ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.739191ms iteration = 126 status = {"config_updated":false}
84322026-10-29T02:49:00.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 138 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = dbf01fe3-2503-4bd8-83a6-63851abd6484 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
84332026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 127 reason = Timeout
84342026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
84352026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84362026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
84372026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
84382026-10-29T02:49:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84392026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
84402026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
84412026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84422026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 57 reason = Timeout
84432026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
84442026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84452026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
84462026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
84472026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 33 reason = Timeout
84482026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
84492026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84502026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84512026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
84522026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84532026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 40 reason = Timeout
84542026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84552026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
84562026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
84572026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84582026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
84592026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84602026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 22 reason = Timeout
84612026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 45 reason = Timeout
84622026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
84632026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
84642026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84652026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 22 reason = Timeout
84662026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 22 reason = Timeout
84672026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
84682026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
84692026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
84702026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84712026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84722026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84732026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 43 reason = Timeout
84742026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
84752026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84762026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
84772026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
84782026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84792026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84802026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
84812026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84822026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84832026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
84842026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84852026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84862026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84872026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84882026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
84892026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
84902026-10-29T02:49:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 405147624 } })
84912026-10-29T02:49:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 405157284 } })
84922026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
84932026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
84942026-10-29T02:49:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
84952026-10-29T02:49:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 405201705 } })
84962026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
84972026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
84982026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b346481-f4e9-4555-b4f3-21929cb466ba", "content-length": "50", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
84992026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85002026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bf5b8ce-b21f-4cc6-a19d-5728da69dcff", "content-length": "50", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
85012026-10-29T02:49:03.727ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
85022026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.403919ms iteration = 22 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
85032026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
85042026-10-29T02:49:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
85052026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6fa0395-e0dd-4d36-b888-71a5f09a6926", "content-length": "681", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
85062026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
85072026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
85082026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
85092026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
85102026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
85112026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
85122026-10-29T02:49:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
85132026-10-29T02:49:03.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85142026-10-29T02:49:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85152026-10-29T02:49:03.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85162026-10-29T02:49:03.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85172026-10-29T02:49:03.729ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 407934942 } })
85182026-10-29T02:49:03.729ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85192026-10-29T02:49:03.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85202026-10-29T02:49:03.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85212026-10-29T02:49:03.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85222026-10-29T02:49:03.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.257338ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85232026-10-29T02:49:03.730ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
85242026-10-29T02:49:03.730ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.149286ms iteration = 22 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
85252026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
85262026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
85272026-10-29T02:49:03.731ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85282026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85292026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85302026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
85312026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
85322026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85332026-10-29T02:49:03.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
85342026-10-29T02:49:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
85352026-10-29T02:49:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85362026-10-29T02:49:03.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85372026-10-29T02:49:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85382026-10-29T02:49:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
85392026-10-29T02:49:03.737ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
85402026-10-29T02:49:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
85412026-10-29T02:49:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85422026-10-29T02:49:03.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85432026-10-29T02:49:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85442026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
85452026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85462026-10-29T02:49:03.738ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85472026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85482026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85492026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
85502026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
85512026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
85522026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
85532026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85542026-10-29T02:49:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
85552026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
85562026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
85572026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
85582026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
85592026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
85602026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
85612026-10-29T02:49:03.739ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
85622026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
85632026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85642026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85652026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
85662026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 14.160934ms iteration = 45 status = {"Loaded":{"time_loaded":"2026-10-29T02:49:03.726306450Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
85672026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
85682026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85692026-10-29T02:49:03.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85702026-10-29T02:49:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85712026-10-29T02:49:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85722026-10-29T02:49:03.743ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
85732026-10-29T02:49:03.743ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
85742026-10-29T02:49:03.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85752026-10-29T02:49:03.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85762026-10-29T02:49:03.743ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "debd7568-5043-498e-8f01-5161ebd8972a", "content-length": "81", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
85772026-10-29T02:49:03.744ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = fab426b7-5900-492d-ac33-1daa90da0830 original_time_started = 2026-10-29 02:48:35.619367 UTC
85782026-10-29T02:49:03.744ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 18.111697ms iteration = 57 status = {"Loaded":{"collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","time_loaded":"2026-10-29T02:49:03.726137156Z","time_started":"2026-10-29T02:48:35.619367Z"}}
85792026-10-29T02:49:03.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
85802026-10-29T02:49:03.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85812026-10-29T02:49:03.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85822026-10-29T02:49:03.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85832026-10-29T02:49:03.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85842026-10-29T02:49:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85852026-10-29T02:49:03.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85862026-10-29T02:49:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85872026-10-29T02:49:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85882026-10-29T02:49:03.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85892026-10-29T02:49:03.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
85902026-10-29T02:49:03.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85912026-10-29T02:49:03.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
85922026-10-29T02:49:03.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85932026-10-29T02:49:03.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85942026-10-29T02:49:03.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85952026-10-29T02:49:03.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85962026-10-29T02:49:03.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85972026-10-29T02:49:03.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85982026-10-29T02:49:03.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85992026-10-29T02:49:03.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002026-10-29T02:49:03.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86012026-10-29T02:49:03.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86022026-10-29T02:49:03.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86032026-10-29T02:49:03.806ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 80.430792ms iteration = 40 status = {"disks_added":0,"errors":[]}
86042026-10-29T02:49:03.847ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
86052026-10-29T02:49:03.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.281471ms iteration = 64 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
86062026-10-29T02:49:03.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86072026-10-29T02:49:03.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86082026-10-29T02:49:03.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86092026-10-29T02:49:03.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86102026-10-29T02:49:03.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 131.063594ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
86112026-10-29T02:49:03.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.378851ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86122026-10-29T02:49:03.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86132026-10-29T02:49:03.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86142026-10-29T02:49:03.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.478214ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86152026-10-29T02:49:03.859ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 133.711529ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
86162026-10-29T02:49:03.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86172026-10-29T02:49:03.861ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
86182026-10-29T02:49:03.861ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
86192026-10-29T02:49:03.861ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86202026-10-29T02:49:03.861ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1584b33-4ef9-455b-baa5-9658f7f4bdbe", "content-length": "81", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
86212026-10-29T02:49:03.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 135.728541ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
86222026-10-29T02:49:03.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.985978ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
86232026-10-29T02:49:03.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86242026-10-29T02:49:03.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86252026-10-29T02:49:03.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86262026-10-29T02:49:03.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
86272026-10-29T02:49:03.867ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
86282026-10-29T02:49:03.867ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
86292026-10-29T02:49:03.867ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "d806dbd8-928f-4fc9-a250-bb10585065fc", "content-length": "81", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
86302026-10-29T02:49:03.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86312026-10-29T02:49:03.867ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
86322026-10-29T02:49:03.867ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 141.602524ms iteration = 22 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
86332026-10-29T02:49:03.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
86342026-10-29T02:49:03.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86352026-10-29T02:49:03.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86362026-10-29T02:49:03.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86372026-10-29T02:49:03.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86382026-10-29T02:49:03.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86392026-10-29T02:49:03.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
86402026-10-29T02:49:03.869ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
86412026-10-29T02:49:03.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
86422026-10-29T02:49:03.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86432026-10-29T02:49:03.871ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
86442026-10-29T02:49:03.871ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 145.818711ms iteration = 22 status = {"incomplete_bootstore_configs":[]}
86452026-10-29T02:49:03.872ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86462026-10-29T02:49:03.873ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
86472026-10-29T02:49:03.873ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 146.812351ms iteration = 43 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
86482026-10-29T02:49:03.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86492026-10-29T02:49:03.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
86502026-10-29T02:49:03.876ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86512026-10-29T02:49:03.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 150.015779ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86522026-10-29T02:49:03.876ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86532026-10-29T02:49:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86542026-10-29T02:49:03.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86552026-10-29T02:49:03.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86562026-10-29T02:49:03.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86572026-10-29T02:49:03.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
86582026-10-29T02:49:03.879ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
86592026-10-29T02:49:03.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
86602026-10-29T02:49:03.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86612026-10-29T02:49:03.881ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
86622026-10-29T02:49:03.881ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 155.909621ms iteration = 127 status = {"config_updated":false}
86632026-10-29T02:49:03.882ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86642026-10-29T02:49:03.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86652026-10-29T02:49:03.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
86662026-10-29T02:49:03.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86672026-10-29T02:49:03.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b2310d9-1bb4-4684-b075-caba17a7b9b3", "content-length": "372", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
86682026-10-29T02:49:03.883ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86692026-10-29T02:49:03.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86702026-10-29T02:49:03.883ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86712026-10-29T02:49:03.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.389222ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86722026-10-29T02:49:03.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86732026-10-29T02:49:03.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86742026-10-29T02:49:03.886ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
86752026-10-29T02:49:03.886ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 160.313472ms iteration = 33 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
86762026-10-29T02:49:03.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86772026-10-29T02:49:03.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
86782026-10-29T02:49:03.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86792026-10-29T02:49:03.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86802026-10-29T02:49:03.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86812026-10-29T02:49:03.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
86822026-10-29T02:49:03.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86832026-10-29T02:49:03.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86842026-10-29T02:49:03.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86852026-10-29T02:49:03.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
86862026-10-29T02:49:03.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 236.254191ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86872026-10-29T02:49:03.992ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86882026-10-29T02:49:03.992ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86892026-10-29T02:49:03.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fcadea4a-7acc-4840-98a7-6eec3bc940e8", "date": "Thu, 29 Oct 2026 02:49:03 GMT"} })
86902026-10-29T02:49:03.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86912026-10-29T02:49:03.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86922026-10-29T02:49:03.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86932026-10-29T02:49:03.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86942026-10-29T02:49:04.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86952026-10-29T02:49:04.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86962026-10-29T02:49:04.005ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86972026-10-29T02:49:04.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86982026-10-29T02:49:04.006ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16abe600-34c2-431d-aa14-e3849dfbfc04", "date": "Thu, 29 Oct 2026 02:49:04 GMT"} })
86992026-10-29T02:49:04.006ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.192724ms iteration = 33 status = {}
87002026-10-29T02:49:04.044ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
87012026-10-29T02:49:04.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c076a2c-b736-4b94-bf79-458fd1aa2128", "content-length": "691", "date": "Thu, 29 Oct 2026 02:49:04 GMT"} })
87022026-10-29T02:49:04.044ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
87032026-10-29T02:49:04.044ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
87042026-10-29T02:49:04.044ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
87052026-10-29T02:49:04.044ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 312.816231ms iteration = 22 status = {}
87062026-10-29T02:49:08.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 128 reason = Timeout
87072026-10-29T02:49:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87082026-10-29T02:49:08.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87092026-10-29T02:49:08.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87102026-10-29T02:49:08.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
87112026-10-29T02:49:08.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87122026-10-29T02:49:08.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87132026-10-29T02:49:08.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
87142026-10-29T02:49:08.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.972176ms iteration = 128 status = {"config_updated":false}
87152026-10-29T02:49:10.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 124 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 283b5003-0b80-4cab-b245-c105908e288d response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
87162026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 129 reason = Timeout
87172026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87182026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
87192026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87202026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
87212026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87222026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87232026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
87242026-10-29T02:49:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87252026-10-29T02:49:13.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87262026-10-29T02:49:13.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87272026-10-29T02:49:13.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87282026-10-29T02:49:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87292026-10-29T02:49:13.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.385611ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87302026-10-29T02:49:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87312026-10-29T02:49:13.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87322026-10-29T02:49:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
87332026-10-29T02:49:13.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87342026-10-29T02:49:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
87352026-10-29T02:49:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87362026-10-29T02:49:13.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
87372026-10-29T02:49:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.800104ms iteration = 129 status = {"config_updated":false}
87382026-10-29T02:49:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87392026-10-29T02:49:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
87402026-10-29T02:49:13.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87412026-10-29T02:49:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
87422026-10-29T02:49:13.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87432026-10-29T02:49:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
87442026-10-29T02:49:13.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
87452026-10-29T02:49:13.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.461825ms iteration = 65 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
87462026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 130 reason = Timeout
87472026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87482026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 58 reason = Timeout
87492026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
87502026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 46 reason = Timeout
87512026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
87522026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 44 reason = Timeout
87532026-10-29T02:49:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
87542026-10-29T02:49:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
87552026-10-29T02:49:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
87562026-10-29T02:49:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
87572026-10-29T02:49:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87582026-10-29T02:49:18.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87592026-10-29T02:49:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87602026-10-29T02:49:18.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87612026-10-29T02:49:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87622026-10-29T02:49:18.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
87632026-10-29T02:49:18.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
87642026-10-29T02:49:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
87652026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
87662026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87672026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
87682026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
87692026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87702026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
87712026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
87722026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
87732026-10-29T02:49:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
87742026-10-29T02:49:18.736ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
87752026-10-29T02:49:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.789604ms iteration = 46 status = {"Loaded":{"time_loaded":"2026-10-29T02:49:18.726848205Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
87762026-10-29T02:49:18.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
87772026-10-29T02:49:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.534739ms iteration = 44 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
87782026-10-29T02:49:18.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = fab426b7-5900-492d-ac33-1daa90da0830 original_time_started = 2026-10-29 02:48:35.619367 UTC
87792026-10-29T02:49:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.814545ms iteration = 58 status = {"Loaded":{"collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","time_loaded":"2026-10-29T02:49:18.726808935Z","time_started":"2026-10-29T02:48:35.619367Z"}}
87802026-10-29T02:49:18.737ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
87812026-10-29T02:49:18.738ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 11.258184ms iteration = 130 status = {"config_updated":false}
87822026-10-29T02:49:20.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 124 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 9463d586-8fe1-4a4a-bd76-c8f1fcb47dd1 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
87832026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 131 reason = Timeout
87842026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87852026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
87862026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87872026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
87882026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87892026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87902026-10-29T02:49:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87912026-10-29T02:49:23.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
87922026-10-29T02:49:23.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87932026-10-29T02:49:23.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87942026-10-29T02:49:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
87952026-10-29T02:49:23.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
87962026-10-29T02:49:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
87972026-10-29T02:49:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87982026-10-29T02:49:23.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87992026-10-29T02:49:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
88002026-10-29T02:49:23.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
88012026-10-29T02:49:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.61787ms iteration = 131 status = {"config_updated":false}
88022026-10-29T02:49:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88032026-10-29T02:49:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
88042026-10-29T02:49:23.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052026-10-29T02:49:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
88062026-10-29T02:49:23.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88072026-10-29T02:49:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
88082026-10-29T02:49:23.767ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
88092026-10-29T02:49:23.767ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.406611ms iteration = 66 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
88102026-10-29T02:49:23.778ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88112026-10-29T02:49:23.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88122026-10-29T02:49:23.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.086164ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88132026-10-29T02:49:28.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 132 reason = Timeout
88142026-10-29T02:49:28.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
88152026-10-29T02:49:28.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
88162026-10-29T02:49:28.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172026-10-29T02:49:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
88182026-10-29T02:49:28.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
88192026-10-29T02:49:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
88202026-10-29T02:49:28.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
88212026-10-29T02:49:28.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.298543ms iteration = 132 status = {"config_updated":false}
88222026-10-29T02:49:30.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 193 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 85e29c63-2042-4766-85d7-ceadfe4eddb8 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
88232026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 133 reason = Timeout
88242026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 23 reason = Timeout
88252026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
88262026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
88272026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
88282026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88292026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88302026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
88312026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
88322026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 23 reason = Timeout
88332026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 12 reason = Timeout
88342026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 41 reason = Timeout
88352026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
88362026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
88372026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88382026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
88392026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 33 reason = Timeout
88402026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88412026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
88422026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 12 reason = Timeout
88432026-10-29T02:49:33.726ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
88442026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
88452026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
88462026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88472026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 12 reason = Timeout
88482026-10-29T02:49:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
88492026-10-29T02:49:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
88502026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
88512026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
88522026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88532026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
88542026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88552026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
88562026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88572026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
88582026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
88592026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
88602026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88612026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
88622026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 23 reason = Timeout
88632026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
88642026-10-29T02:49:33.727ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88652026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88662026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
88672026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88682026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88692026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 34 reason = Timeout
88702026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88712026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
88722026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 32 reason = Timeout
88732026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
88742026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
88752026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88762026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 59 reason = Timeout
88772026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
88782026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
88792026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
88802026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 30 reason = Timeout
88812026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 47 reason = Timeout
88822026-10-29T02:49:33.727ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
88832026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
88842026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 10.89\u{b5}s iteration = 30 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
88852026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
88862026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
88872026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
88882026-10-29T02:49:33.727ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
88892026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
88902026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88912026-10-29T02:49:33.727ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = ExternalNetworking step id = Ensure
88922026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
88932026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
88942026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
88952026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88962026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 45 reason = Timeout
88972026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
88982026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
88992026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
89002026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
89012026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
89022026-10-29T02:49:33.727ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:39:33.727336731 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89032026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
89042026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89052026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
89062026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89072026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
89082026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
89092026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89102026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89112026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89122026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89132026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
89142026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
89152026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89162026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
89172026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
89182026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89192026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
89202026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89212026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
89222026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89232026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89242026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89252026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89262026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89272026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
89282026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
89292026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89302026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
89312026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89322026-10-29T02:49:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
89332026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
89342026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
89352026-10-29T02:49:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 406281667 } })
89362026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
89372026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
89382026-10-29T02:49:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 406297377 } })
89392026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89402026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
89412026-10-29T02:49:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 406313817 } })
89422026-10-29T02:49:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 406332248 } })
89432026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
89442026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89452026-10-29T02:49:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 406341778 } })
89462026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
89472026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "eff16142-a4d4-437e-b4ea-2559325334f9", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89482026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89492026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
89502026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89512026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "92ec2461-6915-4dee-887a-ead79219c537", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89522026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89532026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89542026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 993.141\u{b5}s iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89552026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89562026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.094583ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89572026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8be999e5-f9eb-4874-9b58-f5c159c526cb", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89582026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89592026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bc2b6f2e-f054-4497-a6ca-008bca3e625b", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89602026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89612026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9e1321ae-4776-4822-a45d-ab9cf516411e", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89622026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89632026-10-29T02:49:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89642026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
89652026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.202235ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89662026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
89672026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
89682026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.492771ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
89692026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb545ea-d72b-4def-af56-f77807f014d8", "content-length": "50", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} })
89702026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b39868a6-07ab-494b-a36b-91f5867e8143", "content-length": "50", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} })
89712026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89722026-10-29T02:49:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
89732026-10-29T02:49:33.729ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
89742026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 2.219996ms iteration = 23 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
89752026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
89762026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89772026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "17452bca-4a93-42f3-97d1-31c01f3044f3", "content-length": "681", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} })
89782026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
89792026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
89802026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
89812026-10-29T02:49:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
89822026-10-29T02:49:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
89832026-10-29T02:49:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
89842026-10-29T02:49:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
89852026-10-29T02:49:33.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89862026-10-29T02:49:33.731ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 409318260 } })
89872026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89882026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89892026-10-29T02:49:33.731ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
89902026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89912026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.986763ms iteration = 12 status = {"by_rx":{},"error":null}
89922026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89932026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89942026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
89952026-10-29T02:49:33.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89962026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
89972026-10-29T02:49:33.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
89982026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89992026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 12 reason = Timeout
90002026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
90012026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
90022026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
90032026-10-29T02:49:33.732ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:39:33.727336731 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
90042026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90052026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.84065ms iteration = 12 status = {"expiration":"2026-10-29T02:39:33.727336731Z","pruned":[]}
90062026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90072026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
90082026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90092026-10-29T02:49:33.732ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
90102026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 5.689249ms iteration = 23 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
90112026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
90122026-10-29T02:49:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90132026-10-29T02:49:33.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90142026-10-29T02:49:33.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90152026-10-29T02:49:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.852222ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90162026-10-29T02:49:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.104238ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
90172026-10-29T02:49:33.734ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90182026-10-29T02:49:33.734ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90192026-10-29T02:49:33.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90202026-10-29T02:49:33.734ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90212026-10-29T02:49:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
90222026-10-29T02:49:33.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90232026-10-29T02:49:33.735ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
90242026-10-29T02:49:33.736ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90252026-10-29T02:49:33.736ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
90262026-10-29T02:49:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
90272026-10-29T02:49:33.737ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
90282026-10-29T02:49:33.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
90292026-10-29T02:49:33.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
90302026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
90312026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.416319ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
90322026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90332026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90342026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90352026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90362026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
90372026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
90382026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
90392026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
90402026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
90412026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
90422026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90432026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90442026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90452026-10-29T02:49:33.745ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
90462026-10-29T02:49:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
90472026-10-29T02:49:33.746ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
90482026-10-29T02:49:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
90492026-10-29T02:49:33.746ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
90502026-10-29T02:49:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
90512026-10-29T02:49:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
90522026-10-29T02:49:33.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
90532026-10-29T02:49:33.747ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
90542026-10-29T02:49:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
90552026-10-29T02:49:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
90562026-10-29T02:49:33.749ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
90572026-10-29T02:49:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
90582026-10-29T02:49:33.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
90592026-10-29T02:49:33.749ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
90602026-10-29T02:49:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
90612026-10-29T02:49:33.751ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622026-10-29T02:49:33.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
90632026-10-29T02:49:33.751ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
90642026-10-29T02:49:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
90652026-10-29T02:49:33.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
90662026-10-29T02:49:33.753ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
90672026-10-29T02:49:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
90682026-10-29T02:49:33.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90692026-10-29T02:49:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90702026-10-29T02:49:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90712026-10-29T02:49:33.755ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90722026-10-29T02:49:33.756ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
90732026-10-29T02:49:33.756ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
90742026-10-29T02:49:33.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
90752026-10-29T02:49:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90762026-10-29T02:49:33.779ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90772026-10-29T02:49:33.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90782026-10-29T02:49:33.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90792026-10-29T02:49:33.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
90802026-10-29T02:49:33.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90812026-10-29T02:49:33.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
90822026-10-29T02:49:33.837ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
90832026-10-29T02:49:33.837ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 110.865765ms iteration = 133 status = {"config_updated":false}
90842026-10-29T02:49:33.847ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
90852026-10-29T02:49:33.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
90862026-10-29T02:49:33.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90872026-10-29T02:49:33.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
90882026-10-29T02:49:33.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90892026-10-29T02:49:33.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90902026-10-29T02:49:33.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90912026-10-29T02:49:33.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
90922026-10-29T02:49:33.861ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = fab426b7-5900-492d-ac33-1daa90da0830 original_time_started = 2026-10-29 02:48:35.619367 UTC
90932026-10-29T02:49:33.861ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 134.552516ms iteration = 59 status = {"Loaded":{"collection_id":"fab426b7-5900-492d-ac33-1daa90da0830","time_loaded":"2026-10-29T02:49:33.727189078Z","time_started":"2026-10-29T02:48:35.619367Z"}}
90942026-10-29T02:49:33.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90952026-10-29T02:49:33.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
90962026-10-29T02:49:33.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
90972026-10-29T02:49:33.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
90982026-10-29T02:49:33.879ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
90992026-10-29T02:49:33.879ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 153.00623ms iteration = 33 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
91002026-10-29T02:49:33.880ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91012026-10-29T02:49:33.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91022026-10-29T02:49:33.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91032026-10-29T02:49:33.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91042026-10-29T02:49:33.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
91052026-10-29T02:49:33.886ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
91062026-10-29T02:49:33.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
91072026-10-29T02:49:33.887ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
91082026-10-29T02:49:33.887ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
91092026-10-29T02:49:33.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91102026-10-29T02:49:33.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91112026-10-29T02:49:33.887ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91122026-10-29T02:49:33.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91132026-10-29T02:49:33.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
91142026-10-29T02:49:33.888ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "f68ea9c3-b690-4a4b-a388-bc33ff051dcc", "content-length": "81", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} })
91152026-10-29T02:49:33.888ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
91162026-10-29T02:49:33.888ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
91172026-10-29T02:49:33.889ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "5849ed3a-c8f2-421e-8570-6238b6b0fdfc", "content-length": "81", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} })
91182026-10-29T02:49:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91192026-10-29T02:49:33.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91202026-10-29T02:49:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91212026-10-29T02:49:33.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
91222026-10-29T02:49:33.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91232026-10-29T02:49:33.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
91242026-10-29T02:49:33.893ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
91252026-10-29T02:49:33.893ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 166.175514ms iteration = 45 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
91262026-10-29T02:49:33.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272026-10-29T02:49:33.895ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
91282026-10-29T02:49:33.895ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 168.505812ms iteration = 47 status = {"Loaded":{"time_loaded":"2026-10-29T02:49:33.727212328Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
91292026-10-29T02:49:33.897ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 170.081235ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
91302026-10-29T02:49:33.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91312026-10-29T02:49:33.900ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 173.236731ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
91322026-10-29T02:49:33.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91332026-10-29T02:49:33.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91342026-10-29T02:49:33.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91352026-10-29T02:49:33.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91362026-10-29T02:49:33.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91372026-10-29T02:49:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
91382026-10-29T02:49:33.904ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 172.558806ms iteration = 12 status = {"samples_queued":6}
91392026-10-29T02:49:33.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
91402026-10-29T02:49:33.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
91412026-10-29T02:49:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
91422026-10-29T02:49:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91432026-10-29T02:49:33.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91442026-10-29T02:49:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
91452026-10-29T02:49:33.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91462026-10-29T02:49:33.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 182.705418ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91472026-10-29T02:49:33.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91482026-10-29T02:49:33.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91492026-10-29T02:49:33.913ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91502026-10-29T02:49:33.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
91512026-10-29T02:49:33.913ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91522026-10-29T02:49:33.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91532026-10-29T02:49:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91542026-10-29T02:49:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
91552026-10-29T02:49:33.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91562026-10-29T02:49:33.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91572026-10-29T02:49:33.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91582026-10-29T02:49:33.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91592026-10-29T02:49:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91602026-10-29T02:49:33.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91612026-10-29T02:49:33.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91622026-10-29T02:49:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91632026-10-29T02:49:33.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
91642026-10-29T02:49:33.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91652026-10-29T02:49:33.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91662026-10-29T02:49:33.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91672026-10-29T02:49:33.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 190.916028ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91682026-10-29T02:49:33.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91692026-10-29T02:49:33.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91702026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
91712026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91722026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
91732026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
91742026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91752026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91762026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
91772026-10-29T02:49:33.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91782026-10-29T02:49:33.925ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91792026-10-29T02:49:33.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91802026-10-29T02:49:33.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91812026-10-29T02:49:33.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91822026-10-29T02:49:33.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91832026-10-29T02:49:33.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 202.053439ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
91842026-10-29T02:49:33.932ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91852026-10-29T02:49:33.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91862026-10-29T02:49:33.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91872026-10-29T02:49:33.942ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91882026-10-29T02:49:33.942ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91892026-10-29T02:49:33.942ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91902026-10-29T02:49:33.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91912026-10-29T02:49:33.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
91922026-10-29T02:49:33.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
91932026-10-29T02:49:33.943ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6c8c2a-86ad-4785-a8ed-c016f2d82f78", "content-length": "691", "date": "Thu, 29 Oct 2026 02:49:33 GMT"} })
91942026-10-29T02:49:33.943ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
91952026-10-29T02:49:33.943ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
91962026-10-29T02:49:33.943ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
91972026-10-29T02:49:33.943ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 211.979686ms iteration = 23 status = {}
91982026-10-29T02:49:33.946ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992026-10-29T02:49:33.948ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
92002026-10-29T02:49:33.948ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
92012026-10-29T02:49:33.948ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 220.82156ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
92022026-10-29T02:49:33.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92032026-10-29T02:49:33.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
92042026-10-29T02:49:33.951ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92052026-10-29T02:49:33.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92062026-10-29T02:49:33.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92072026-10-29T02:49:33.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92082026-10-29T02:49:33.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92092026-10-29T02:49:33.966ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
92102026-10-29T02:49:33.966ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
92112026-10-29T02:49:33.966ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
92122026-10-29T02:49:33.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92132026-10-29T02:49:33.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92142026-10-29T02:49:33.967ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
92152026-10-29T02:49:33.967ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 240.793605ms iteration = 34 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
92162026-10-29T02:49:33.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92172026-10-29T02:49:33.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92182026-10-29T02:49:33.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92192026-10-29T02:49:33.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92202026-10-29T02:49:33.991ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92212026-10-29T02:49:33.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92222026-10-29T02:49:33.996ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92232026-10-29T02:49:33.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92242026-10-29T02:49:34.010ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 283.259427ms iteration = 41 status = {"disks_added":0,"errors":[]}
92252026-10-29T02:49:34.015ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
92262026-10-29T02:49:34.015ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
92272026-10-29T02:49:34.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92282026-10-29T02:49:34.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92292026-10-29T02:49:34.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
92302026-10-29T02:49:34.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
92312026-10-29T02:49:34.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92322026-10-29T02:49:34.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332026-10-29T02:49:34.026ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
92342026-10-29T02:49:34.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 299.330972ms iteration = 67 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
92352026-10-29T02:49:34.028ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
92362026-10-29T02:49:34.028ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
92372026-10-29T02:49:34.029ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ff07948-461e-4934-9fa7-487da8064d5b", "content-length": "81", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
92382026-10-29T02:49:34.029ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
92392026-10-29T02:49:34.029ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 302.687512ms iteration = 23 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
92402026-10-29T02:49:34.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92412026-10-29T02:49:34.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92422026-10-29T02:49:34.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92432026-10-29T02:49:34.031ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
92442026-10-29T02:49:34.034ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
92452026-10-29T02:49:34.034ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92462026-10-29T02:49:34.034ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
92472026-10-29T02:49:34.034ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 307.319038ms iteration = 12 status = {"generation":2}
92482026-10-29T02:49:34.036ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
92492026-10-29T02:49:34.041ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
92502026-10-29T02:49:34.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 316.07872ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92512026-10-29T02:49:34.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
92522026-10-29T02:49:34.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
92532026-10-29T02:49:34.052ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
92542026-10-29T02:49:34.052ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
92552026-10-29T02:49:34.052ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 320.41634ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
92562026-10-29T02:49:34.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92572026-10-29T02:49:34.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92582026-10-29T02:49:34.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92592026-10-29T02:49:34.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92602026-10-29T02:49:34.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92612026-10-29T02:49:34.060ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
92622026-10-29T02:49:34.060ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 333.921881ms iteration = 23 status = {"incomplete_bootstore_configs":[]}
92632026-10-29T02:49:34.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92642026-10-29T02:49:34.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 334.192266ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
92652026-10-29T02:49:34.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
92662026-10-29T02:49:34.061ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
92672026-10-29T02:49:34.064ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92682026-10-29T02:49:34.064ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 337.080226ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92692026-10-29T02:49:34.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92702026-10-29T02:49:34.066ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
92712026-10-29T02:49:34.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92722026-10-29T02:49:34.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92732026-10-29T02:49:34.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
92742026-10-29T02:49:34.073ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
92752026-10-29T02:49:34.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
92762026-10-29T02:49:34.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
92772026-10-29T02:49:34.079ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
92782026-10-29T02:49:34.080ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 759055539 } })
92792026-10-29T02:49:34.082ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 355.55826ms iteration = 12 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
92802026-10-29T02:49:34.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92812026-10-29T02:49:34.083ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
92822026-10-29T02:49:34.083ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 356.96527ms iteration = 12 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
92832026-10-29T02:49:34.087ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
92842026-10-29T02:49:34.087ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
92852026-10-29T02:49:34.087ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
92862026-10-29T02:49:34.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92872026-10-29T02:49:34.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92882026-10-29T02:49:34.088ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
92892026-10-29T02:49:34.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92902026-10-29T02:49:34.101ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
92912026-10-29T02:49:34.105ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
92922026-10-29T02:49:34.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92932026-10-29T02:49:34.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92942026-10-29T02:49:34.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92952026-10-29T02:49:34.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
92962026-10-29T02:49:34.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
92972026-10-29T02:49:34.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92982026-10-29T02:49:34.118ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92992026-10-29T02:49:34.118ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93002026-10-29T02:49:34.118ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 391.11713ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93012026-10-29T02:49:34.122ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
93022026-10-29T02:49:34.125ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
93032026-10-29T02:49:34.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93042026-10-29T02:49:34.130ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
93052026-10-29T02:49:34.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
93062026-10-29T02:49:34.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
93072026-10-29T02:49:34.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
93082026-10-29T02:49:34.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93092026-10-29T02:49:34.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93102026-10-29T02:49:34.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93112026-10-29T02:49:34.146ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
93122026-10-29T02:49:34.150ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
93132026-10-29T02:49:34.153ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
93142026-10-29T02:49:34.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93152026-10-29T02:49:34.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93162026-10-29T02:49:34.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93172026-10-29T02:49:34.165ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
93182026-10-29T02:49:34.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93192026-10-29T02:49:34.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
93202026-10-29T02:49:34.169ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
93212026-10-29T02:49:34.169ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 442.901526ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
93222026-10-29T02:49:34.174ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
93232026-10-29T02:49:34.175ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
93242026-10-29T02:49:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
93252026-10-29T02:49:34.176ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
93262026-10-29T02:49:34.177ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
93272026-10-29T02:49:34.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 450.506444ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
93282026-10-29T02:49:34.177ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = SledList step id = Fetch
93292026-10-29T02:49:34.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93302026-10-29T02:49:34.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93312026-10-29T02:49:34.179ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93322026-10-29T02:49:34.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93332026-10-29T02:49:34.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
93342026-10-29T02:49:34.185ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
93352026-10-29T02:49:34.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
93362026-10-29T02:49:34.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
93372026-10-29T02:49:34.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93382026-10-29T02:49:34.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93392026-10-29T02:49:34.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93402026-10-29T02:49:34.193ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
93412026-10-29T02:49:34.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93422026-10-29T02:49:34.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93432026-10-29T02:49:34.200ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = DeployNexusRecords step id = Ensure
93442026-10-29T02:49:34.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93452026-10-29T02:49:34.200ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93462026-10-29T02:49:34.200ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93472026-10-29T02:49:34.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93482026-10-29T02:49:34.201ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e802c3f9-d85f-4047-96bd-a67a08f6f073", "content-length": "372", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
93492026-10-29T02:49:34.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93502026-10-29T02:49:34.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93512026-10-29T02:49:34.202ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
93522026-10-29T02:49:34.202ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "576a20a9-4650-44bb-8fc6-61364ea55972", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
93532026-10-29T02:49:34.202ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
93542026-10-29T02:49:34.202ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
93552026-10-29T02:49:34.202ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 475.756439ms iteration = 12 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
93562026-10-29T02:49:34.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93572026-10-29T02:49:34.204ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
93582026-10-29T02:49:34.204ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
93592026-10-29T02:49:34.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93602026-10-29T02:49:34.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93612026-10-29T02:49:34.205ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
93622026-10-29T02:49:34.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93632026-10-29T02:49:34.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93642026-10-29T02:49:34.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
93652026-10-29T02:49:34.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
93662026-10-29T02:49:34.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93672026-10-29T02:49:34.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
93682026-10-29T02:49:34.226ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
93692026-10-29T02:49:34.226ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93702026-10-29T02:49:34.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7ecb0dcd-145c-49e7-9d3e-baa0dbcfe5a3", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
93712026-10-29T02:49:34.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93722026-10-29T02:49:34.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93732026-10-29T02:49:34.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
93742026-10-29T02:49:34.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
93752026-10-29T02:49:34.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93762026-10-29T02:49:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93772026-10-29T02:49:34.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93782026-10-29T02:49:34.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93792026-10-29T02:49:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93802026-10-29T02:49:34.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
93812026-10-29T02:49:34.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
93822026-10-29T02:49:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
93832026-10-29T02:49:34.245ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93842026-10-29T02:49:34.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93852026-10-29T02:49:34.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fef1db2c-5825-4730-8af6-4e5e2cf19d34", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
93862026-10-29T02:49:34.245ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 518.729871ms iteration = 34 status = {}
93872026-10-29T02:49:34.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 35 reason = Dependency
93882026-10-29T02:49:34.245ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93892026-10-29T02:49:34.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93902026-10-29T02:49:34.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93912026-10-29T02:49:34.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93922026-10-29T02:49:34.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93932026-10-29T02:49:34.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93942026-10-29T02:49:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93952026-10-29T02:49:34.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962026-10-29T02:49:34.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93972026-10-29T02:49:34.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93982026-10-29T02:49:34.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93992026-10-29T02:49:34.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94002026-10-29T02:49:34.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94012026-10-29T02:49:34.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94022026-10-29T02:49:34.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94032026-10-29T02:49:34.307ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
94042026-10-29T02:49:34.307ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94052026-10-29T02:49:34.307ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
94062026-10-29T02:49:34.307ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 575.603874ms iteration = 12 status = {"generation":1}
94072026-10-29T02:49:34.313ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = SledAgent step id = Ensure
94082026-10-29T02:49:34.314ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
94092026-10-29T02:49:34.317ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "7331a866-5804-4b92-b1c3-14b95491d42f", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
94102026-10-29T02:49:34.317ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = FirewallRules step id = Ensure
94112026-10-29T02:49:34.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94122026-10-29T02:49:34.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94132026-10-29T02:49:34.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94142026-10-29T02:49:34.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94152026-10-29T02:49:34.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94162026-10-29T02:49:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94172026-10-29T02:49:34.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94182026-10-29T02:49:34.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94192026-10-29T02:49:34.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94202026-10-29T02:49:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94212026-10-29T02:49:34.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94222026-10-29T02:49:34.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94232026-10-29T02:49:34.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94242026-10-29T02:49:34.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94252026-10-29T02:49:34.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94262026-10-29T02:49:34.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94272026-10-29T02:49:34.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
94282026-10-29T02:49:34.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94292026-10-29T02:49:34.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94302026-10-29T02:49:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
94312026-10-29T02:49:34.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94322026-10-29T02:49:34.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94332026-10-29T02:49:34.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94342026-10-29T02:49:34.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94352026-10-29T02:49:34.417ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94362026-10-29T02:49:34.417ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94372026-10-29T02:49:34.418ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "375033f2-f897-45c1-b0b0-475cb2702b07", "content-length": "372", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
94382026-10-29T02:49:34.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94392026-10-29T02:49:34.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94402026-10-29T02:49:34.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94412026-10-29T02:49:34.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94422026-10-29T02:49:34.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94432026-10-29T02:49:34.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94442026-10-29T02:49:34.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94452026-10-29T02:49:34.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
94462026-10-29T02:49:34.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94472026-10-29T02:49:34.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94482026-10-29T02:49:34.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94492026-10-29T02:49:34.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
94502026-10-29T02:49:34.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94512026-10-29T02:49:34.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94522026-10-29T02:49:34.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94532026-10-29T02:49:34.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94542026-10-29T02:49:34.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94552026-10-29T02:49:34.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94562026-10-29T02:49:34.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94572026-10-29T02:49:34.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94582026-10-29T02:49:34.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94592026-10-29T02:49:34.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94602026-10-29T02:49:34.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94612026-10-29T02:49:34.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94622026-10-29T02:49:34.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94632026-10-29T02:49:34.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
94642026-10-29T02:49:34.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94652026-10-29T02:49:34.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94662026-10-29T02:49:34.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94672026-10-29T02:49:34.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94682026-10-29T02:49:34.516ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94692026-10-29T02:49:34.516ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94702026-10-29T02:49:34.517ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "da63d2ad-9e51-44ae-8551-d01ffa55a9d3", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
94712026-10-29T02:49:34.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94722026-10-29T02:49:34.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94732026-10-29T02:49:34.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94742026-10-29T02:49:34.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94752026-10-29T02:49:34.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94762026-10-29T02:49:34.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94772026-10-29T02:49:34.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94782026-10-29T02:49:34.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94792026-10-29T02:49:34.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94802026-10-29T02:49:34.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94812026-10-29T02:49:34.527ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94822026-10-29T02:49:34.527ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94832026-10-29T02:49:34.527ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7630b9a5-9741-4cda-bcb8-be64c08aff1b", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
94842026-10-29T02:49:34.527ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 282.065602ms iteration = 35 status = {}
94852026-10-29T02:49:34.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94862026-10-29T02:49:34.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
94872026-10-29T02:49:34.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
94882026-10-29T02:49:34.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
94892026-10-29T02:49:34.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94902026-10-29T02:49:34.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
94912026-10-29T02:49:34.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94922026-10-29T02:49:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94932026-10-29T02:49:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94942026-10-29T02:49:34.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
94952026-10-29T02:49:34.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94962026-10-29T02:49:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94972026-10-29T02:49:34.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
94982026-10-29T02:49:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
94992026-10-29T02:49:34.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95002026-10-29T02:49:34.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95012026-10-29T02:49:34.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95022026-10-29T02:49:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95032026-10-29T02:49:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95042026-10-29T02:49:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95052026-10-29T02:49:34.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95062026-10-29T02:49:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95072026-10-29T02:49:34.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95082026-10-29T02:49:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95092026-10-29T02:49:34.644ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
95102026-10-29T02:49:34.644ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
95112026-10-29T02:49:34.644ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST operation_id = cpapi_producers_post uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
95122026-10-29T02:49:34.644ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:1057 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:51493
95132026-10-29T02:49:34.644ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51493 req_id = b97f42c4-91ea-475c-bdd0-97f148c1577f uri = /metrics/producers version = 1.0.0
95142026-10-29T02:49:34.644ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51493 req_id = b97f42c4-91ea-475c-bdd0-97f148c1577f roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
95152026-10-29T02:49:34.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51493 req_id = b97f42c4-91ea-475c-bdd0-97f148c1577f resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
95162026-10-29T02:49:34.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95172026-10-29T02:49:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95182026-10-29T02:49:34.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95192026-10-29T02:49:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95202026-10-29T02:49:34.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95212026-10-29T02:49:34.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95222026-10-29T02:49:34.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
95232026-10-29T02:49:34.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95242026-10-29T02:49:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95252026-10-29T02:49:34.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95262026-10-29T02:49:34.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
95272026-10-29T02:49:34.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95282026-10-29T02:49:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95292026-10-29T02:49:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95302026-10-29T02:49:34.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95312026-10-29T02:49:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95322026-10-29T02:49:34.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95332026-10-29T02:49:34.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95342026-10-29T02:49:34.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95352026-10-29T02:49:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95362026-10-29T02:49:34.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95372026-10-29T02:49:34.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95382026-10-29T02:49:34.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
95392026-10-29T02:49:34.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95402026-10-29T02:49:34.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
95412026-10-29T02:49:34.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95422026-10-29T02:49:34.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95432026-10-29T02:49:34.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95442026-10-29T02:49:34.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95452026-10-29T02:49:34.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95462026-10-29T02:49:34.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95472026-10-29T02:49:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95482026-10-29T02:49:34.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95492026-10-29T02:49:34.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95502026-10-29T02:49:34.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95512026-10-29T02:49:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95522026-10-29T02:49:34.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95532026-10-29T02:49:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95542026-10-29T02:49:34.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95552026-10-29T02:49:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95562026-10-29T02:49:34.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95572026-10-29T02:49:34.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
95582026-10-29T02:49:34.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95592026-10-29T02:49:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95602026-10-29T02:49:34.717ZINFOnexus: assigned collector to new producer collector_id = 8a46c129-dc41-46f0-b0fe-5dc9b5402b19 file = nexus/src/app/oximeter.rs:78 producer_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7
95612026-10-29T02:49:34.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 73619 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51493 req_id = b97f42c4-91ea-475c-bdd0-97f148c1577f response_code = 201 uri = /metrics/producers
95622026-10-29T02:49:34.718ZDEBGnexus (producer-registration-task): client response operation_id = cpapi_producers_post result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b97f42c4-91ea-475c-bdd0-97f148c1577f", "content-length": "41", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
95632026-10-29T02:49:34.718ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
95642026-10-29T02:49:34.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95652026-10-29T02:49:34.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95662026-10-29T02:49:34.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95672026-10-29T02:49:34.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95682026-10-29T02:49:34.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95692026-10-29T02:49:34.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
95702026-10-29T02:49:34.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95712026-10-29T02:49:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95722026-10-29T02:49:34.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95732026-10-29T02:49:34.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95742026-10-29T02:49:34.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95752026-10-29T02:49:34.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
95762026-10-29T02:49:34.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
95772026-10-29T02:49:34.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
95782026-10-29T02:49:34.778ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
95792026-10-29T02:49:34.778ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
95802026-10-29T02:49:34.778ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
95812026-10-29T02:49:34.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95822026-10-29T02:49:34.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95832026-10-29T02:49:34.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95842026-10-29T02:49:34.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95852026-10-29T02:49:34.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95862026-10-29T02:49:34.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
95872026-10-29T02:49:34.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95882026-10-29T02:49:34.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95892026-10-29T02:49:34.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95902026-10-29T02:49:34.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95912026-10-29T02:49:34.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95922026-10-29T02:49:34.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
95932026-10-29T02:49:34.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95942026-10-29T02:49:34.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95952026-10-29T02:49:34.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
95962026-10-29T02:49:34.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
95972026-10-29T02:49:34.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95982026-10-29T02:49:34.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
95992026-10-29T02:49:34.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
96002026-10-29T02:49:34.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
96012026-10-29T02:49:34.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
96022026-10-29T02:49:34.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
96032026-10-29T02:49:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96042026-10-29T02:49:34.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
96052026-10-29T02:49:34.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
96062026-10-29T02:49:34.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
96072026-10-29T02:49:34.913ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
96082026-10-29T02:49:34.913ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
96092026-10-29T02:49:34.913ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 4b544963-6be6-4325-9cf3-302be4c2f80c parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
96102026-10-29T02:49:34.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
96112026-10-29T02:49:34.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
96122026-10-29T02:49:34.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96132026-10-29T02:49:34.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
96142026-10-29T02:49:34.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
96152026-10-29T02:49:34.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
96162026-10-29T02:49:34.923ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
96172026-10-29T02:49:34.923ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
96182026-10-29T02:49:34.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 1.196438558s iteration = 32 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
96192026-10-29T02:49:34.940ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
96202026-10-29T02:49:34.940ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
96212026-10-29T02:49:34.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96222026-10-29T02:49:34.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96232026-10-29T02:49:34.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96242026-10-29T02:49:34.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96252026-10-29T02:49:34.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96262026-10-29T02:49:34.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
96272026-10-29T02:49:34.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
96282026-10-29T02:49:34.949ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "245b9306-306a-4855-8495-eef73b86e66e", "date": "Thu, 29 Oct 2026 02:49:34 GMT"} })
96292026-10-29T02:49:34.949ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
96302026-10-29T02:49:34.949ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = Dns step id = Ensure
96312026-10-29T02:49:34.949ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
96322026-10-29T02:49:34.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96332026-10-29T02:49:34.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96342026-10-29T02:49:34.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96352026-10-29T02:49:34.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96362026-10-29T02:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372026-10-29T02:49:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96382026-10-29T02:49:34.961ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
96392026-10-29T02:49:34.961ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
96402026-10-29T02:49:34.961ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
96412026-10-29T02:49:34.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96422026-10-29T02:49:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96432026-10-29T02:49:34.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96442026-10-29T02:49:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96452026-10-29T02:49:34.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96462026-10-29T02:49:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96472026-10-29T02:49:35.012ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
96482026-10-29T02:49:35.012ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
96492026-10-29T02:49:35.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96502026-10-29T02:49:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96512026-10-29T02:49:35.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522026-10-29T02:49:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96532026-10-29T02:49:35.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96542026-10-29T02:49:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96552026-10-29T02:49:35.022ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
96562026-10-29T02:49:35.022ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
96572026-10-29T02:49:35.022ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
96582026-10-29T02:49:35.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96592026-10-29T02:49:35.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96602026-10-29T02:49:35.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96612026-10-29T02:49:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96622026-10-29T02:49:35.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96632026-10-29T02:49:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96642026-10-29T02:49:35.082ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
96652026-10-29T02:49:35.082ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
96662026-10-29T02:49:35.082ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
96672026-10-29T02:49:35.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96682026-10-29T02:49:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96692026-10-29T02:49:35.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96702026-10-29T02:49:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96712026-10-29T02:49:35.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96722026-10-29T02:49:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96732026-10-29T02:49:35.090ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
96742026-10-29T02:49:35.090ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
96752026-10-29T02:49:35.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96762026-10-29T02:49:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96772026-10-29T02:49:35.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96782026-10-29T02:49:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96792026-10-29T02:49:35.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96802026-10-29T02:49:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96812026-10-29T02:49:35.099ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
96822026-10-29T02:49:35.099ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
96832026-10-29T02:49:35.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96842026-10-29T02:49:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96852026-10-29T02:49:35.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96862026-10-29T02:49:35.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
96872026-10-29T02:49:35.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96882026-10-29T02:49:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96892026-10-29T02:49:35.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96902026-10-29T02:49:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96912026-10-29T02:49:35.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
96922026-10-29T02:49:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
96932026-10-29T02:49:35.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96942026-10-29T02:49:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
96952026-10-29T02:49:35.117ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
96962026-10-29T02:49:35.117ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
96972026-10-29T02:49:35.117ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = OmicronZones step id = Cleanup
96982026-10-29T02:49:35.117ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = OmicronZones step id = Cleanup
96992026-10-29T02:49:35.117ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = PhysicalDisks step id = Cleanup
97002026-10-29T02:49:35.117ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = Clickhouse step id = Ensure
97012026-10-29T02:49:35.117ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = Clickhouse step id = Ensure
97022026-10-29T02:49:35.117ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
97032026-10-29T02:49:35.121ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "616e9952-1ab9-428c-97b2-b6b18bfc1f1b", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97042026-10-29T02:49:35.121ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = SupportBundles step id = Cleanup
97052026-10-29T02:49:35.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97062026-10-29T02:49:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97072026-10-29T02:49:35.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97082026-10-29T02:49:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
97092026-10-29T02:49:35.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97102026-10-29T02:49:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97112026-10-29T02:49:35.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97122026-10-29T02:49:35.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97132026-10-29T02:49:35.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97142026-10-29T02:49:35.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
97152026-10-29T02:49:35.180ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = OmicronZones step id = Cleanup
97162026-10-29T02:49:35.180ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
97172026-10-29T02:49:35.180ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
97182026-10-29T02:49:35.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97192026-10-29T02:49:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97202026-10-29T02:49:35.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212026-10-29T02:49:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
97222026-10-29T02:49:35.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97232026-10-29T02:49:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97242026-10-29T02:49:35.237ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
97252026-10-29T02:49:35.237ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
97262026-10-29T02:49:35.237ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = OmicronZones step id = Cleanup
97272026-10-29T02:49:35.237ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
97282026-10-29T02:49:35.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97292026-10-29T02:49:35.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97302026-10-29T02:49:35.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97312026-10-29T02:49:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
97322026-10-29T02:49:35.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97332026-10-29T02:49:35.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97342026-10-29T02:49:35.341ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
97352026-10-29T02:49:35.341ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = Cockroach step id = Ensure
97362026-10-29T02:49:35.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
97372026-10-29T02:49:35.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
97382026-10-29T02:49:35.350ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
97392026-10-29T02:49:35.350ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = f6d56448-b439-4fe8-826a-65f5873a3d75 step component = MgsUpdates step id = Ensure
97402026-10-29T02:49:35.350ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 14 reason = Dependency
97412026-10-29T02:49:35.350ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 35 reason = Dependency
97422026-10-29T02:49:35.350ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97432026-10-29T02:49:35.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97442026-10-29T02:49:35.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.623529205s iteration = 13 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":2750,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":450279499,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":450279449,"secs":0}},"event_index":1,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":450292570,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":22838775,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":22838715,"secs":0}},"event_index":2,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":473141474,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":113440608,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":113440558,"secs":0}},"event_index":3,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":586605533,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3344389,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3344359,"secs":0}},"event_index":4,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":589977153,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":632132159,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":632132119,"secs":0}},"event_index":5,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":222118082,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":168135015,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":168134975,"secs":0}},"event_index":6,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":390260707,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":5050,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":5010,"secs":0}},"event_index":7,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":390278357,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2200,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2170,"secs":0}},"event_index":8,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":390282557,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2960,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":2920,"secs":0}},"event_index":9,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":390287408,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":1551,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":1511,"secs":0}},"event_index":10,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":390290548,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3536454,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":3536414,"secs":0}},"event_index":11,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":393827831,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":59188701,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":59188661,"secs":0}},"event_index":12,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":453023181,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":56855371,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":56855322,"secs":0}},"event_index":13,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":509897583,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":103972351,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":103972311,"secs":0}},"event_index":14,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":613887045,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":9273413,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":9273363,"secs":0}},"event_index":15,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":623176488,"secs":1}},{"data":{"attempt_elapsed":{"nanos":4390,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":4350,"secs":0}},"event_index":16,"execution_id":"f6d56448-b439-4fe8-826a-65f5873a3d75","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":623188468,"secs":1}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
97452026-10-29T02:49:35.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97462026-10-29T02:49:35.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
97472026-10-29T02:49:35.352ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482026-10-29T02:49:35.352ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97492026-10-29T02:49:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97502026-10-29T02:49:35.355ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97512026-10-29T02:49:35.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97522026-10-29T02:49:35.356ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
97532026-10-29T02:49:35.356ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97542026-10-29T02:49:35.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
97552026-10-29T02:49:35.360ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(1a9d73ff-cd50-45b2-b39a-0fc2072eac56, 0), (574dd761-49fc-4f6e-8935-f6a5c6b88826, 0), (fab426b7-5900-492d-ac33-1daa90da0830, 0)]
97562026-10-29T02:49:35.360ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1337, tv_nsec: 38890480 } })
97572026-10-29T02:49:35.361ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1337, tv_nsec: 40046904 } })
97582026-10-29T02:49:35.362ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
97592026-10-29T02:49:35.362ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
97602026-10-29T02:49:35.362ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
97612026-10-29T02:49:35.362ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be62714b-eaea-4af3-9a7d-0185d995b762", "content-length": "50", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97622026-10-29T02:49:35.362ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
97632026-10-29T02:49:35.363ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "16801968-f062-445b-9988-675c7f18e9f6", "content-length": "681", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97642026-10-29T02:49:35.363ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
97652026-10-29T02:49:35.363ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95ca425c-479f-4520-974d-7b3af15c7948", "content-length": "734", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97662026-10-29T02:49:35.363ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
97672026-10-29T02:49:35.364ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eacc0d29-8f5b-428a-a65b-82fa33951e4f", "content-length": "111", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97682026-10-29T02:49:35.364ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
97692026-10-29T02:49:35.364ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "61ff2a13-4e77-484e-824f-bf09bbb97b84", "content-length": "111", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97702026-10-29T02:49:35.364ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
97712026-10-29T02:49:35.365ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "af12e9bf-ab95-472c-9213-e2f31806a4a7", "content-length": "163", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97722026-10-29T02:49:35.365ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
97732026-10-29T02:49:35.365ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebe3903d-f44e-4f8a-8e6e-7d70cd4080a7", "content-length": "163", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97742026-10-29T02:49:35.365ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
97752026-10-29T02:49:35.366ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ed15297-8151-4465-b02b-45ee37c1155a", "content-length": "166", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97762026-10-29T02:49:35.366ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
97772026-10-29T02:49:35.366ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "685c4baf-4126-4b37-861a-2be6931c392f", "content-length": "166", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97782026-10-29T02:49:35.366ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
97792026-10-29T02:49:35.367ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d821ddd7-96e9-4130-8391-9ac5450a9a98", "content-length": "702", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97802026-10-29T02:49:35.367ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
97812026-10-29T02:49:35.367ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1550dbc-f1d9-4838-bbf7-b1c6d36bcac5", "content-length": "727", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97822026-10-29T02:49:35.367ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
97832026-10-29T02:49:35.367ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06c15172-8996-47a5-b209-25c5788ef034", "content-length": "729", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97842026-10-29T02:49:35.367ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
97852026-10-29T02:49:35.368ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6cf3bad-3115-4659-9a69-2c4a71c4cbca", "content-length": "728", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97862026-10-29T02:49:35.368ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
97872026-10-29T02:49:35.368ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d83ee7-a456-4f8a-84c2-668ebd4c94af", "content-length": "722", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97882026-10-29T02:49:35.368ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
97892026-10-29T02:49:35.368ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "516a1a1a-931a-4818-b141-ccee544d24c6", "content-length": "10", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97902026-10-29T02:49:35.368ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
97912026-10-29T02:49:35.369ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "04f7702f-0fe3-46ae-9143-47ae116f16e1", "content-length": "144", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97922026-10-29T02:49:35.369ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
97932026-10-29T02:49:35.369ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "78a6cd80-5451-4b0e-b1a6-27bae5dcdf3b", "content-length": "147", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97942026-10-29T02:49:35.369ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
97952026-10-29T02:49:35.369ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "184711a7-2722-46e4-9ad8-eb5f4cfd1e78", "content-length": "109", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97962026-10-29T02:49:35.369ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
97972026-10-29T02:49:35.370ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6affdd69-cca2-48b6-ac7c-970b8bfdcb7a", "content-length": "109", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
97982026-10-29T02:49:35.370ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
97992026-10-29T02:49:35.370ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa82931e-1608-45bd-8b87-e815c200f2ab", "content-length": "163", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98002026-10-29T02:49:35.370ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
98012026-10-29T02:49:35.371ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0d0acae-c6b2-4274-a39c-55a0b5dd5d11", "content-length": "163", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98022026-10-29T02:49:35.371ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
98032026-10-29T02:49:35.371ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b7b951d-cd91-4872-bb23-15f40fcff31d", "content-length": "166", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98042026-10-29T02:49:35.371ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
98052026-10-29T02:49:35.372ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d6c86ef-b69e-4622-82ef-f9b9846b6c10", "content-length": "166", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98062026-10-29T02:49:35.372ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
98072026-10-29T02:49:35.372ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cebb6fb-a143-4e07-a607-51ee641f8889", "content-length": "702", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98082026-10-29T02:49:35.372ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
98092026-10-29T02:49:35.372ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "34cdf6cc-0756-471a-b4a5-5d1f5654c6d9", "content-length": "727", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98102026-10-29T02:49:35.372ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
98112026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4941194a-a69b-4fca-8d1c-b54172948032", "content-length": "729", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98122026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
98132026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ad39ea-798d-44bc-9c88-5fddd12c85b6", "content-length": "728", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98142026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
98152026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de2717f-0e38-443f-bfc4-8a3822dc4aeb", "content-length": "722", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98162026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
98172026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "4664f070-ee04-47a3-a8d5-f93117cf5ca9", "content-length": "10", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98182026-10-29T02:49:35.373ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
98192026-10-29T02:49:35.374ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "38af767b-8e22-4931-968a-7af6e45b3cce", "content-length": "144", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98202026-10-29T02:49:35.374ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
98212026-10-29T02:49:35.374ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "143e724d-46f2-4fd8-92bf-93e2eb237ccf", "content-length": "147", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98222026-10-29T02:49:35.374ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
98232026-10-29T02:49:35.374ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a42e4a0a-9be2-42f3-af51-7c864436ff6f", "content-length": "109", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98242026-10-29T02:49:35.374ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
98252026-10-29T02:49:35.375ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7db7265-276a-42e6-b5ab-14e89b346d1d", "content-length": "109", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98262026-10-29T02:49:35.375ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
98272026-10-29T02:49:35.375ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "089dd305-8640-4c00-b725-bcafc8494a76", "content-length": "163", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98282026-10-29T02:49:35.375ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
98292026-10-29T02:49:35.376ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0245f3bd-74fd-4f87-9377-1d505d4f90a7", "content-length": "163", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98302026-10-29T02:49:35.376ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
98312026-10-29T02:49:35.376ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c43b6425-7c6e-4e3a-abfb-6bb7c5b290f5", "content-length": "166", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98322026-10-29T02:49:35.376ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
98332026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2849d42c-d9cf-4980-9e31-aa0e26735094", "content-length": "166", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98342026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
98352026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fb97bd9-255a-4c52-82b9-71d94cf48648", "content-length": "702", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98362026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
98372026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d5981c-1b83-42f1-85b1-efba8fa0cb60", "content-length": "727", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98382026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
98392026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d6a69e-8854-4c27-a6f6-4de2094d6a01", "content-length": "729", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98402026-10-29T02:49:35.377ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
98412026-10-29T02:49:35.378ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae81155e-30b3-40ff-9411-74f5400f4270", "content-length": "728", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98422026-10-29T02:49:35.378ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
98432026-10-29T02:49:35.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
98442026-10-29T02:49:35.380ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98452026-10-29T02:49:35.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
98462026-10-29T02:49:35.383ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
98472026-10-29T02:49:35.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
98482026-10-29T02:49:35.385ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98492026-10-29T02:49:35.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
98502026-10-29T02:49:35.387ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
98512026-10-29T02:49:35.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
98522026-10-29T02:49:35.411ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98532026-10-29T02:49:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98542026-10-29T02:49:35.413ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98552026-10-29T02:49:35.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98562026-10-29T02:49:35.416ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98572026-10-29T02:49:35.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98582026-10-29T02:49:35.418ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
98592026-10-29T02:49:35.418ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 68.074634ms iteration = 35 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
98602026-10-29T02:49:35.483ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
98612026-10-29T02:49:35.483ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
98622026-10-29T02:49:35.532ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd033b72-00a9-45fa-899a-88197784c212", "content-length": "93658", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98632026-10-29T02:49:35.532ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
98642026-10-29T02:49:35.533ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
98652026-10-29T02:49:35.533ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
98662026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
98672026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
98682026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
98692026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
98702026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
98712026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0221c165-215d-4282-9b94-4bfe2905bda0", "content-length": "64", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98722026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29a2b7b1-b3aa-4b09-8c6e-3ecc1ac97a5d", "content-length": "64", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98732026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
98742026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
98752026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0d86a6e-ce48-4484-8438-ecae48827cc4", "content-length": "64", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98762026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
98772026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f416da6a-c46b-4d19-a0c3-1e543bd69380", "content-length": "64", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98782026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1139a6ea-6082-4d41-9673-3f39d722506b", "content-length": "64", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98792026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
98802026-10-29T02:49:35.533ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
98812026-10-29T02:49:35.539ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f54b18b-2ac0-4410-993d-57a0bdfaefb2", "content-length": "418668", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98822026-10-29T02:49:35.539ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d781b0f-db1e-44f3-93db-5bb699a2a655", "content-length": "423417", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98832026-10-29T02:49:35.539ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "4696a50b-0e56-4eb4-9d46-96c8d983252e", "content-length": "432447", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98842026-10-29T02:49:35.539ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "87172025-d421-488a-92f6-9e76a837913b", "content-length": "418872", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98852026-10-29T02:49:35.540ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbf9a3fa-f7d7-4775-bae3-da8f85c5f556", "content-length": "420651", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98862026-10-29T02:49:35.543ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
98872026-10-29T02:49:35.544ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
98882026-10-29T02:49:35.544ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
98892026-10-29T02:49:35.544ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
98902026-10-29T02:49:35.544ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
98912026-10-29T02:49:35.544ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
98922026-10-29T02:49:35.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
98932026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e91944-38f2-46e0-bb6f-4b6b62a77caa", "content-length": "259", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
98942026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
98952026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
98962026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
98972026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
98982026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
98992026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
99002026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
99012026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "764f8f7d-8c09-4600-8b5e-d2edb50df5fb", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
99022026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0878a54-7384-411c-9677-e9c6c1669bab", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
99032026-10-29T02:49:35.548ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cc172f6-8a46-4d3e-b1df-ff632b041f31", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:49:35 GMT"} })
99042026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
99052026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
99062026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
99072026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
99082026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
99092026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99102026-10-29T02:49:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
99112026-10-29T02:49:35.551ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99122026-10-29T02:49:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
99132026-10-29T02:49:35.553ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99142026-10-29T02:49:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
99152026-10-29T02:49:35.817ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 file = nexus/db-queries/src/db/datastore/inventory.rs:2241
99162026-10-29T02:49:35.817ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 time_started = 2026-10-29 02:49:35.362411 UTC
99172026-10-29T02:49:35.817ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 60 reason = Dependency
99182026-10-29T02:49:35.817ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
99192026-10-29T02:49:35.817ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 467.444165ms iteration = 14 status = {"collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","time_done":"2026-10-29 02:49:35.549113 UTC","time_started":"2026-10-29 02:49:35.362411 UTC"}
99202026-10-29T02:49:35.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
99212026-10-29T02:49:35.820ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99222026-10-29T02:49:35.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
99232026-10-29T02:49:35.823ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
99242026-10-29T02:49:35.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
99252026-10-29T02:49:35.825ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
99262026-10-29T02:49:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
99272026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 42 reason = Dependency
99282026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 63.591501ms iteration = 60 status = {"Loaded":{"collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","time_loaded":"2026-10-29T02:49:35.817972295Z","time_started":"2026-10-29T02:49:35.362411Z"}}
99292026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 29 reason = Dependency
99302026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 33 reason = Dependency
99312026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 23 reason = Dependency
99322026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99332026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99342026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
99352026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
99362026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 31 reason = Dependency
99372026-10-29T02:49:35.881ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
99382026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 15.77\u{b5}s iteration = 31 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
99392026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
99402026-10-29T02:49:35.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99412026-10-29T02:49:35.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99422026-10-29T02:49:35.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
99432026-10-29T02:49:35.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99442026-10-29T02:49:35.883ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99452026-10-29T02:49:35.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99462026-10-29T02:49:35.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99472026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
99482026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
99492026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
99502026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99512026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99522026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
99532026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99542026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99552026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
99562026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99572026-10-29T02:49:35.887ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
99582026-10-29T02:49:35.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
99592026-10-29T02:49:35.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99602026-10-29T02:49:35.889ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99612026-10-29T02:49:35.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99622026-10-29T02:49:35.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99632026-10-29T02:49:35.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99642026-10-29T02:49:35.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
99652026-10-29T02:49:35.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
99662026-10-29T02:49:35.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99672026-10-29T02:49:35.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
99682026-10-29T02:49:35.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
99692026-10-29T02:49:35.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99702026-10-29T02:49:35.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99712026-10-29T02:49:35.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
99722026-10-29T02:49:35.895ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
99732026-10-29T02:49:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99742026-10-29T02:49:35.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99752026-10-29T02:49:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
99762026-10-29T02:49:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99772026-10-29T02:49:35.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99782026-10-29T02:49:35.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99792026-10-29T02:49:35.899ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
99802026-10-29T02:49:35.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
99812026-10-29T02:49:35.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99822026-10-29T02:49:35.902ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
99832026-10-29T02:49:35.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99842026-10-29T02:49:35.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99852026-10-29T02:49:35.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99862026-10-29T02:49:35.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99872026-10-29T02:49:35.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99882026-10-29T02:49:35.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
99892026-10-29T02:49:35.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99902026-10-29T02:49:35.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99912026-10-29T02:49:35.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99922026-10-29T02:49:35.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
99932026-10-29T02:49:35.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99942026-10-29T02:49:35.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99952026-10-29T02:49:35.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99962026-10-29T02:49:35.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99972026-10-29T02:49:35.951ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99982026-10-29T02:49:35.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99992026-10-29T02:49:35.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100002026-10-29T02:49:35.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100012026-10-29T02:49:35.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100022026-10-29T02:49:35.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100032026-10-29T02:49:35.958ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100042026-10-29T02:49:35.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100052026-10-29T02:49:35.959ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100062026-10-29T02:49:35.959ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 78.354429ms iteration = 42 status = {"disks_added":0,"errors":[]}
100072026-10-29T02:49:35.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100082026-10-29T02:49:35.962ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100092026-10-29T02:49:35.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
100102026-10-29T02:49:35.964ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100112026-10-29T02:49:35.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100122026-10-29T02:49:35.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100132026-10-29T02:49:35.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100142026-10-29T02:49:35.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100152026-10-29T02:49:35.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100162026-10-29T02:49:35.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100172026-10-29T02:49:35.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100182026-10-29T02:49:35.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100192026-10-29T02:49:35.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100202026-10-29T02:49:35.986ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
100212026-10-29T02:49:35.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100222026-10-29T02:49:35.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100232026-10-29T02:49:35.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100242026-10-29T02:49:35.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100252026-10-29T02:49:35.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100262026-10-29T02:49:35.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100272026-10-29T02:49:35.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100282026-10-29T02:49:35.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100292026-10-29T02:49:35.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100302026-10-29T02:49:35.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100312026-10-29T02:49:35.998ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
100322026-10-29T02:49:35.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100332026-10-29T02:49:35.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100342026-10-29T02:49:36.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100352026-10-29T02:49:36.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100362026-10-29T02:49:36.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100372026-10-29T02:49:36.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
100382026-10-29T02:49:36.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100392026-10-29T02:49:36.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100402026-10-29T02:49:36.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100412026-10-29T02:49:36.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
100422026-10-29T02:49:36.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100432026-10-29T02:49:36.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100442026-10-29T02:49:36.016ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100452026-10-29T02:49:36.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100462026-10-29T02:49:36.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100472026-10-29T02:49:36.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100482026-10-29T02:49:36.018ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100492026-10-29T02:49:36.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100502026-10-29T02:49:36.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
100512026-10-29T02:49:36.021ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100522026-10-29T02:49:36.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100532026-10-29T02:49:36.023ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100542026-10-29T02:49:36.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100552026-10-29T02:49:36.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
100562026-10-29T02:49:36.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100572026-10-29T02:49:36.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100582026-10-29T02:49:36.025ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100592026-10-29T02:49:36.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100602026-10-29T02:49:36.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100612026-10-29T02:49:36.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
100622026-10-29T02:49:36.028ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100632026-10-29T02:49:36.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100642026-10-29T02:49:36.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100652026-10-29T02:49:36.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
100662026-10-29T02:49:36.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100672026-10-29T02:49:36.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100682026-10-29T02:49:36.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100692026-10-29T02:49:36.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100702026-10-29T02:49:36.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100712026-10-29T02:49:36.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
100722026-10-29T02:49:36.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100732026-10-29T02:49:36.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100742026-10-29T02:49:36.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100752026-10-29T02:49:36.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100762026-10-29T02:49:36.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100772026-10-29T02:49:36.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100782026-10-29T02:49:36.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100792026-10-29T02:49:36.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100802026-10-29T02:49:36.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100812026-10-29T02:49:36.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
100822026-10-29T02:49:36.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100832026-10-29T02:49:36.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100842026-10-29T02:49:36.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100852026-10-29T02:49:36.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100862026-10-29T02:49:36.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100872026-10-29T02:49:36.085ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
100882026-10-29T02:49:36.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100892026-10-29T02:49:36.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
100902026-10-29T02:49:36.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
100912026-10-29T02:49:36.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
100922026-10-29T02:49:36.087ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100932026-10-29T02:49:36.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100942026-10-29T02:49:36.090ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
100952026-10-29T02:49:36.090ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 22 reason = Dependency
100962026-10-29T02:49:36.090ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
100972026-10-29T02:49:36.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 209.137897ms iteration = 23 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
100982026-10-29T02:49:36.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
100992026-10-29T02:49:36.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
101002026-10-29T02:49:36.091ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
101012026-10-29T02:49:36.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
101022026-10-29T02:49:36.094ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
101032026-10-29T02:49:36.094ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
101042026-10-29T02:49:36.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
101052026-10-29T02:49:36.096ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101062026-10-29T02:49:36.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
101072026-10-29T02:49:36.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101082026-10-29T02:49:36.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101092026-10-29T02:49:36.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
101102026-10-29T02:49:36.099ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
101112026-10-29T02:49:36.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
101122026-10-29T02:49:36.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101132026-10-29T02:49:36.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101142026-10-29T02:49:36.102ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
101152026-10-29T02:49:36.102ZINFOnexus (BackgroundTasks): building sitrep 3843c573-6094-467e-afa9-d2b521d138ef (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 3843c573-6094-467e-afa9-d2b521d138ef (sitrep)
101162026-10-29T02:49:36.102ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
101172026-10-29T02:49:36.102ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 220.752139ms iteration = 29 status = {"inv_collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:49:36.102279174Z","outcome":"Unchanged","start_time":"2026-10-29T02:49:36.102255244Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
101182026-10-29T02:49:36.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101192026-10-29T02:49:36.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
101202026-10-29T02:49:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101212026-10-29T02:49:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101222026-10-29T02:49:36.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101232026-10-29T02:49:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101242026-10-29T02:49:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101252026-10-29T02:49:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101262026-10-29T02:49:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101272026-10-29T02:49:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
101282026-10-29T02:49:36.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101292026-10-29T02:49:36.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101302026-10-29T02:49:36.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101312026-10-29T02:49:36.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101322026-10-29T02:49:36.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101332026-10-29T02:49:36.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
101342026-10-29T02:49:36.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101352026-10-29T02:49:36.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101362026-10-29T02:49:36.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101372026-10-29T02:49:36.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101382026-10-29T02:49:36.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101392026-10-29T02:49:36.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
101402026-10-29T02:49:36.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101412026-10-29T02:49:36.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101422026-10-29T02:49:36.140ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101432026-10-29T02:49:36.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101442026-10-29T02:49:36.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101452026-10-29T02:49:36.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
101462026-10-29T02:49:36.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101472026-10-29T02:49:36.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101482026-10-29T02:49:36.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101492026-10-29T02:49:36.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101502026-10-29T02:49:36.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101512026-10-29T02:49:36.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
101522026-10-29T02:49:36.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101532026-10-29T02:49:36.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101542026-10-29T02:49:36.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101552026-10-29T02:49:36.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101562026-10-29T02:49:36.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101572026-10-29T02:49:36.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
101582026-10-29T02:49:36.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101592026-10-29T02:49:36.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101602026-10-29T02:49:36.188ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
101612026-10-29T02:49:36.188ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 97.707161ms iteration = 22 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
101622026-10-29T02:49:36.188ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 34 reason = Dependency
101632026-10-29T02:49:36.188ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
101642026-10-29T02:49:36.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
101652026-10-29T02:49:36.191ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
101662026-10-29T02:49:36.191ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 3.152066ms iteration = 34 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
101672026-10-29T02:49:36.207ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
101682026-10-29T02:49:36.207ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
101692026-10-29T02:49:36.207ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 2987914f-52e3-4bd8-8dfa-7d97341aa504 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
101702026-10-29T02:49:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101712026-10-29T02:49:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101722026-10-29T02:49:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101732026-10-29T02:49:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
101742026-10-29T02:49:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
101752026-10-29T02:49:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
101762026-10-29T02:49:36.217ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 1 limit = 5000 usage_percent = 0
101772026-10-29T02:49:36.217ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
101782026-10-29T02:49:36.217ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 336.212448ms iteration = 33 status = {"Unchanged":{"blueprint_count":1,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
101792026-10-29T02:49:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 134 reason = Timeout
101802026-10-29T02:49:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
101812026-10-29T02:49:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
101822026-10-29T02:49:38.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101832026-10-29T02:49:38.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
101842026-10-29T02:49:38.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
101852026-10-29T02:49:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
101862026-10-29T02:49:38.733ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
101872026-10-29T02:49:38.733ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.644299ms iteration = 134 status = {"config_updated":false}
101882026-10-29T02:49:40.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 216 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 0127cb79-09c1-4dd6-bb10-beb71488a600 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
101892026-10-29T02:49:43.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 135 reason = Timeout
101902026-10-29T02:49:43.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
101912026-10-29T02:49:43.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
101922026-10-29T02:49:43.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
101932026-10-29T02:49:43.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101942026-10-29T02:49:43.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101952026-10-29T02:49:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
101962026-10-29T02:49:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
101972026-10-29T02:49:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101982026-10-29T02:49:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101992026-10-29T02:49:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102002026-10-29T02:49:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
102012026-10-29T02:49:43.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102022026-10-29T02:49:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102032026-10-29T02:49:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102042026-10-29T02:49:43.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102052026-10-29T02:49:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102062026-10-29T02:49:43.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
102072026-10-29T02:49:43.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.189431ms iteration = 135 status = {"config_updated":false}
102082026-10-29T02:49:43.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102092026-10-29T02:49:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102102026-10-29T02:49:43.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102112026-10-29T02:49:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
102122026-10-29T02:49:43.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102132026-10-29T02:49:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102142026-10-29T02:49:43.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
102152026-10-29T02:49:43.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.598868ms iteration = 68 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
102162026-10-29T02:49:43.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102172026-10-29T02:49:43.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102182026-10-29T02:49:43.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.879943ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102192026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 136 reason = Timeout
102202026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102212026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 46 reason = Timeout
102222026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 48 reason = Timeout
102232026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 61 reason = Timeout
102242026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
102252026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
102262026-10-29T02:49:48.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
102272026-10-29T02:49:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102282026-10-29T02:49:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
102292026-10-29T02:49:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
102302026-10-29T02:49:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
102312026-10-29T02:49:48.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102322026-10-29T02:49:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102332026-10-29T02:49:48.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102342026-10-29T02:49:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102352026-10-29T02:49:48.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
102362026-10-29T02:49:48.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
102372026-10-29T02:49:48.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
102382026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
102392026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
102402026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
102412026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
102422026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102432026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
102442026-10-29T02:49:48.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
102452026-10-29T02:49:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102462026-10-29T02:49:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
102472026-10-29T02:49:48.736ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
102482026-10-29T02:49:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.333614ms iteration = 48 status = {"Loaded":{"time_loaded":"2026-10-29T02:49:48.726685533Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
102492026-10-29T02:49:48.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
102502026-10-29T02:49:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.60877ms iteration = 136 status = {"config_updated":false}
102512026-10-29T02:49:48.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 original_time_started = 2026-10-29 02:49:35.362411 UTC
102522026-10-29T02:49:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.235103ms iteration = 61 status = {"Loaded":{"collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","time_loaded":"2026-10-29T02:49:48.726696053Z","time_started":"2026-10-29T02:49:35.362411Z"}}
102532026-10-29T02:49:48.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
102542026-10-29T02:49:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.736313ms iteration = 46 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
102552026-10-29T02:49:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 127 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 2efd51b2-9390-4acd-8845-292d71178391 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
102562026-10-29T02:49:53.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 137 reason = Timeout
102572026-10-29T02:49:53.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
102582026-10-29T02:49:53.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102592026-10-29T02:49:53.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
102602026-10-29T02:49:53.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102612026-10-29T02:49:53.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102622026-10-29T02:49:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102632026-10-29T02:49:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102642026-10-29T02:49:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102652026-10-29T02:49:53.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102662026-10-29T02:49:53.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102672026-10-29T02:49:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
102682026-10-29T02:49:53.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102692026-10-29T02:49:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102702026-10-29T02:49:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102712026-10-29T02:49:53.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102722026-10-29T02:49:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102732026-10-29T02:49:53.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
102742026-10-29T02:49:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.734712ms iteration = 137 status = {"config_updated":false}
102752026-10-29T02:49:53.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102762026-10-29T02:49:53.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102772026-10-29T02:49:53.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102782026-10-29T02:49:53.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
102792026-10-29T02:49:53.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102802026-10-29T02:49:53.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
102812026-10-29T02:49:53.760ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
102822026-10-29T02:49:53.760ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.790152ms iteration = 69 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
102832026-10-29T02:49:53.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102842026-10-29T02:49:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102852026-10-29T02:49:53.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.151999ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102862026-10-29T02:49:58.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 138 reason = Timeout
102872026-10-29T02:49:58.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102882026-10-29T02:49:58.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102892026-10-29T02:49:58.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102902026-10-29T02:49:58.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
102912026-10-29T02:49:58.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102922026-10-29T02:49:58.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
102932026-10-29T02:49:58.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
102942026-10-29T02:49:58.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.204611ms iteration = 138 status = {"config_updated":false}
102952026-10-29T02:50:00.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 178 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = ff333d4b-c9e9-432b-bb6e-373eb6103ddf response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
102962026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 139 reason = Timeout
102972026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
102982026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
102992026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
103002026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 36 reason = Timeout
103012026-10-29T02:50:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103022026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103032026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
103042026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 47 reason = Timeout
103052026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103062026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
103072026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
103082026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103092026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
103102026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103112026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
103122026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103132026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
103142026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
103152026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 24 reason = Timeout
103162026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
103172026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 36 reason = Timeout
103182026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103192026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 49 reason = Timeout
103202026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
103212026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
103222026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103232026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
103242026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
103252026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
103262026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 24 reason = Timeout
103272026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 62 reason = Timeout
103282026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
103292026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
103302026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
103312026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
103322026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 43 reason = Timeout
103332026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103342026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 24 reason = Timeout
103352026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
103362026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
103372026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103382026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
103392026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103402026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
103412026-10-29T02:50:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103422026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
103432026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
103442026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103452026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103462026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103472026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
103482026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
103492026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
103502026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103512026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
103522026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
103532026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
103542026-10-29T02:50:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 405511029 } })
103552026-10-29T02:50:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 405520640 } })
103562026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103572026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
103582026-10-29T02:50:03.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 405580511 } })
103592026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
103602026-10-29T02:50:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
103612026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb7cf2cf-58c3-4a0b-a104-a123bc381039", "content-length": "50", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
103622026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3790c456-7ec3-4525-b91b-63f5e4814616", "content-length": "50", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
103632026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103642026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
103652026-10-29T02:50:03.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
103662026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.47121ms iteration = 24 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
103672026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
103682026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "806f10a5-f6aa-4b77-bef9-e1d1ecd2b242", "content-length": "681", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
103692026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
103702026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
103712026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
103722026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
103732026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
103742026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
103752026-10-29T02:50:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
103762026-10-29T02:50:03.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103772026-10-29T02:50:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103782026-10-29T02:50:03.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103792026-10-29T02:50:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103802026-10-29T02:50:03.730ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 408771777 } })
103812026-10-29T02:50:03.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103822026-10-29T02:50:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
103832026-10-29T02:50:03.731ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
103842026-10-29T02:50:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.844361ms iteration = 24 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
103852026-10-29T02:50:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.640737ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
103862026-10-29T02:50:03.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
103872026-10-29T02:50:03.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103882026-10-29T02:50:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
103892026-10-29T02:50:03.733ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
103902026-10-29T02:50:03.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103912026-10-29T02:50:03.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103922026-10-29T02:50:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103932026-10-29T02:50:03.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
103942026-10-29T02:50:03.736ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
103952026-10-29T02:50:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
103962026-10-29T02:50:03.736ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
103972026-10-29T02:50:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
103982026-10-29T02:50:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
103992026-10-29T02:50:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
104002026-10-29T02:50:03.737ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
104012026-10-29T02:50:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
104022026-10-29T02:50:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104032026-10-29T02:50:03.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104042026-10-29T02:50:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104052026-10-29T02:50:03.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
104062026-10-29T02:50:03.741ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
104072026-10-29T02:50:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
104082026-10-29T02:50:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
104092026-10-29T02:50:03.742ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
104102026-10-29T02:50:03.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104112026-10-29T02:50:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104122026-10-29T02:50:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
104132026-10-29T02:50:03.743ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
104142026-10-29T02:50:03.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104152026-10-29T02:50:03.743ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 16.8369ms iteration = 49 status = {"Loaded":{"time_loaded":"2026-10-29T02:50:03.726490913Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
104162026-10-29T02:50:03.745ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
104172026-10-29T02:50:03.745ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 18.994765ms iteration = 47 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
104182026-10-29T02:50:03.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104192026-10-29T02:50:03.746ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
104202026-10-29T02:50:03.746ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 20.21821ms iteration = 139 status = {"config_updated":false}
104212026-10-29T02:50:03.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104222026-10-29T02:50:03.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104232026-10-29T02:50:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104242026-10-29T02:50:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104252026-10-29T02:50:03.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104262026-10-29T02:50:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104272026-10-29T02:50:03.752ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
104282026-10-29T02:50:03.753ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104292026-10-29T02:50:03.753ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c614680-c3a3-4bfb-bbe1-2582d301c585", "content-length": "372", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
104302026-10-29T02:50:03.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104312026-10-29T02:50:03.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104322026-10-29T02:50:03.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104332026-10-29T02:50:03.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
104342026-10-29T02:50:03.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
104352026-10-29T02:50:03.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
104362026-10-29T02:50:03.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
104372026-10-29T02:50:03.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
104382026-10-29T02:50:03.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392026-10-29T02:50:03.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
104402026-10-29T02:50:03.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
104412026-10-29T02:50:03.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
104422026-10-29T02:50:03.852ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
104432026-10-29T02:50:03.852ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 126.122261ms iteration = 36 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
104442026-10-29T02:50:03.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104452026-10-29T02:50:03.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104462026-10-29T02:50:03.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104472026-10-29T02:50:03.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104482026-10-29T02:50:03.856ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
104492026-10-29T02:50:03.856ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
104502026-10-29T02:50:03.857ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "17d2f44d-76d5-4540-ae98-6c59afdea088", "content-length": "81", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
104512026-10-29T02:50:03.857ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
104522026-10-29T02:50:03.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104532026-10-29T02:50:03.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
104542026-10-29T02:50:03.862ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
104552026-10-29T02:50:03.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
104562026-10-29T02:50:03.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
104572026-10-29T02:50:03.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 136.681421ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
104582026-10-29T02:50:03.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104592026-10-29T02:50:03.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.955311ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104602026-10-29T02:50:03.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104612026-10-29T02:50:03.877ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
104622026-10-29T02:50:03.877ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
104632026-10-29T02:50:03.877ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "7374153f-e61f-41e3-97b5-86eff90999aa", "content-length": "81", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
104642026-10-29T02:50:03.880ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104652026-10-29T02:50:03.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104662026-10-29T02:50:03.882ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104672026-10-29T02:50:03.882ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104682026-10-29T02:50:03.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104692026-10-29T02:50:03.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
104702026-10-29T02:50:03.885ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 159.26759ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
104712026-10-29T02:50:03.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104722026-10-29T02:50:03.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104732026-10-29T02:50:03.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104742026-10-29T02:50:03.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104752026-10-29T02:50:03.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104762026-10-29T02:50:03.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
104772026-10-29T02:50:03.888ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
104782026-10-29T02:50:03.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
104792026-10-29T02:50:03.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104802026-10-29T02:50:03.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104812026-10-29T02:50:03.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104822026-10-29T02:50:03.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104832026-10-29T02:50:03.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
104842026-10-29T02:50:03.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104852026-10-29T02:50:03.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104862026-10-29T02:50:03.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 167.37689ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
104872026-10-29T02:50:03.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
104882026-10-29T02:50:03.896ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 original_time_started = 2026-10-29 02:49:35.362411 UTC
104892026-10-29T02:50:03.896ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 169.991123ms iteration = 62 status = {"Loaded":{"collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","time_loaded":"2026-10-29T02:50:03.726583745Z","time_started":"2026-10-29T02:49:35.362411Z"}}
104902026-10-29T02:50:03.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104912026-10-29T02:50:03.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104922026-10-29T02:50:03.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104932026-10-29T02:50:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104942026-10-29T02:50:03.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104952026-10-29T02:50:03.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
104962026-10-29T02:50:03.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104972026-10-29T02:50:03.907ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
104982026-10-29T02:50:03.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 180.643494ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
104992026-10-29T02:50:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105002026-10-29T02:50:03.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105012026-10-29T02:50:03.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105022026-10-29T02:50:03.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105032026-10-29T02:50:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
105042026-10-29T02:50:03.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105052026-10-29T02:50:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
105062026-10-29T02:50:03.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105072026-10-29T02:50:03.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105082026-10-29T02:50:03.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105092026-10-29T02:50:03.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105102026-10-29T02:50:03.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105112026-10-29T02:50:03.926ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
105122026-10-29T02:50:03.926ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
105132026-10-29T02:50:03.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "49d00c4a-bd55-407d-9dab-b1d98273c303", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
105142026-10-29T02:50:03.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105152026-10-29T02:50:03.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105162026-10-29T02:50:03.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105172026-10-29T02:50:03.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105182026-10-29T02:50:03.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105192026-10-29T02:50:03.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105202026-10-29T02:50:03.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105212026-10-29T02:50:03.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105222026-10-29T02:50:03.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105232026-10-29T02:50:03.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105242026-10-29T02:50:03.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105252026-10-29T02:50:03.953ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105262026-10-29T02:50:03.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105272026-10-29T02:50:03.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "acdba5a8-d2bf-43cf-93ae-51a2c26cec96", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
105282026-10-29T02:50:03.954ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 228.157742ms iteration = 36 status = {}
105292026-10-29T02:50:03.955ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
105302026-10-29T02:50:03.955ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 229.503731ms iteration = 24 status = {"incomplete_bootstore_configs":[]}
105312026-10-29T02:50:03.957ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
105322026-10-29T02:50:03.957ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 231.143414ms iteration = 70 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
105332026-10-29T02:50:03.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 240.755234ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105342026-10-29T02:50:03.967ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
105352026-10-29T02:50:03.968ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
105362026-10-29T02:50:03.968ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "c291e93f-b178-46a5-90e2-e0624b52e79e", "content-length": "81", "date": "Thu, 29 Oct 2026 02:50:03 GMT"} })
105372026-10-29T02:50:03.968ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
105382026-10-29T02:50:03.968ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 242.053772ms iteration = 24 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
105392026-10-29T02:50:03.971ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105402026-10-29T02:50:03.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105412026-10-29T02:50:03.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 248.572686ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105422026-10-29T02:50:03.976ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105432026-10-29T02:50:03.976ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
105442026-10-29T02:50:03.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105452026-10-29T02:50:03.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
105462026-10-29T02:50:04.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 324.73419ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
105472026-10-29T02:50:04.059ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105482026-10-29T02:50:04.059ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105492026-10-29T02:50:04.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 332.793457ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105502026-10-29T02:50:04.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105512026-10-29T02:50:04.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
105522026-10-29T02:50:04.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105532026-10-29T02:50:04.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
105542026-10-29T02:50:04.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105552026-10-29T02:50:04.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105562026-10-29T02:50:04.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105572026-10-29T02:50:04.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
105582026-10-29T02:50:04.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105592026-10-29T02:50:04.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105602026-10-29T02:50:04.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105612026-10-29T02:50:04.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
105622026-10-29T02:50:04.161ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 434.586033ms iteration = 43 status = {"disks_added":0,"errors":[]}
105632026-10-29T02:50:04.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
105642026-10-29T02:50:04.164ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87c33d05-372c-49f7-bb08-c3d26f8cbb3c", "content-length": "691", "date": "Thu, 29 Oct 2026 02:50:04 GMT"} })
105652026-10-29T02:50:04.164ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
105662026-10-29T02:50:04.164ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
105672026-10-29T02:50:04.164ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
105682026-10-29T02:50:04.164ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 431.736164ms iteration = 24 status = {}
105692026-10-29T02:50:08.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 140 reason = Timeout
105702026-10-29T02:50:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
105712026-10-29T02:50:08.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
105722026-10-29T02:50:08.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105732026-10-29T02:50:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
105742026-10-29T02:50:08.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
105752026-10-29T02:50:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
105762026-10-29T02:50:08.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
105772026-10-29T02:50:08.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.559558ms iteration = 140 status = {"config_updated":false}
105782026-10-29T02:50:10.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 204 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 3cd743f2-cdd2-4a1d-bedc-95243d5a859c response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
105792026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 141 reason = Timeout
105802026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
105812026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
105822026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
105832026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105842026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105852026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
105862026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105872026-10-29T02:50:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
105882026-10-29T02:50:13.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105892026-10-29T02:50:13.730ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105902026-10-29T02:50:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105912026-10-29T02:50:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105922026-10-29T02:50:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
105932026-10-29T02:50:13.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
105942026-10-29T02:50:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
105952026-10-29T02:50:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
105962026-10-29T02:50:13.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105972026-10-29T02:50:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
105982026-10-29T02:50:13.739ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
105992026-10-29T02:50:13.739ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 13.350307ms iteration = 141 status = {"config_updated":false}
106002026-10-29T02:50:13.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106012026-10-29T02:50:13.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
106022026-10-29T02:50:13.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106032026-10-29T02:50:13.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
106042026-10-29T02:50:13.764ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
106052026-10-29T02:50:13.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.298286ms iteration = 71 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
106062026-10-29T02:50:13.781ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106072026-10-29T02:50:13.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106082026-10-29T02:50:13.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.50529ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106092026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 142 reason = Timeout
106102026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106112026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 48 reason = Timeout
106122026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 50 reason = Timeout
106132026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
106142026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
106152026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 63 reason = Timeout
106162026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
106172026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
106182026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
106192026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
106202026-10-29T02:50:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
106212026-10-29T02:50:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106222026-10-29T02:50:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106232026-10-29T02:50:18.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106242026-10-29T02:50:18.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106252026-10-29T02:50:18.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
106262026-10-29T02:50:18.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
106272026-10-29T02:50:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
106282026-10-29T02:50:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
106292026-10-29T02:50:18.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
106302026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
106312026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
106322026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
106332026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106342026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
106352026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
106362026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
106372026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
106382026-10-29T02:50:18.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.530708ms iteration = 50 status = {"Loaded":{"time_loaded":"2026-10-29T02:50:18.726218011Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
106392026-10-29T02:50:18.737ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
106402026-10-29T02:50:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 11.158512ms iteration = 142 status = {"config_updated":false}
106412026-10-29T02:50:18.737ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 original_time_started = 2026-10-29 02:49:35.362411 UTC
106422026-10-29T02:50:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 11.161022ms iteration = 63 status = {"Loaded":{"collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","time_loaded":"2026-10-29T02:50:18.726249232Z","time_started":"2026-10-29T02:49:35.362411Z"}}
106432026-10-29T02:50:18.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
106442026-10-29T02:50:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 11.343356ms iteration = 48 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
106452026-10-29T02:50:20.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 121 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 4375420a-f881-4359-909a-9ceb58524410 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
106462026-10-29T02:50:23.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 143 reason = Timeout
106472026-10-29T02:50:23.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106482026-10-29T02:50:23.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
106492026-10-29T02:50:23.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
106502026-10-29T02:50:23.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106512026-10-29T02:50:23.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106522026-10-29T02:50:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
106532026-10-29T02:50:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106542026-10-29T02:50:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
106552026-10-29T02:50:23.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106562026-10-29T02:50:23.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106572026-10-29T02:50:23.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106582026-10-29T02:50:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106592026-10-29T02:50:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
106602026-10-29T02:50:23.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106612026-10-29T02:50:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
106622026-10-29T02:50:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106632026-10-29T02:50:23.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106642026-10-29T02:50:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
106652026-10-29T02:50:23.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106662026-10-29T02:50:23.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
106672026-10-29T02:50:23.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.115949ms iteration = 143 status = {"config_updated":false}
106682026-10-29T02:50:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
106692026-10-29T02:50:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106702026-10-29T02:50:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
106712026-10-29T02:50:23.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106722026-10-29T02:50:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
106732026-10-29T02:50:23.760ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
106742026-10-29T02:50:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.1855ms iteration = 72 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
106752026-10-29T02:50:23.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.238836ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106762026-10-29T02:50:28.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 144 reason = Timeout
106772026-10-29T02:50:28.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106782026-10-29T02:50:28.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
106792026-10-29T02:50:28.727ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106802026-10-29T02:50:28.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
106812026-10-29T02:50:28.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106822026-10-29T02:50:28.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
106832026-10-29T02:50:28.732ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
106842026-10-29T02:50:28.732ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.161649ms iteration = 144 status = {"config_updated":false}
106852026-10-29T02:50:30.620ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 143 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = ad788838-4970-429e-b307-f9465a6085d3 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
106862026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 145 reason = Timeout
106872026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
106882026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 25 reason = Timeout
106892026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 35 reason = Timeout
106902026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
106912026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
106922026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 44 reason = Timeout
106932026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106942026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106952026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
106962026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
106972026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
106982026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
106992026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107002026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107012026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
107022026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
107032026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 37 reason = Timeout
107042026-10-29T02:50:33.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107052026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107062026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
107072026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107082026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 37 reason = Timeout
107092026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107102026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 13 reason = Timeout
107112026-10-29T02:50:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
107122026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
107132026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
107142026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
107152026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
107162026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107172026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
107182026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
107192026-10-29T02:50:33.726ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
107202026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 13 reason = Timeout
107212026-10-29T02:50:33.726ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
107222026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
107232026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
107242026-10-29T02:50:33.726ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = ExternalNetworking step id = Ensure
107252026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
107262026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
107272026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
107282026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 25 reason = Timeout
107292026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
107302026-10-29T02:50:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
107312026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
107322026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107332026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
107342026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
107352026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107362026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 13 reason = Timeout
107372026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
107382026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
107392026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 49 reason = Timeout
107402026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107412026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
107422026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
107432026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
107442026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107452026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107462026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107472026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 51 reason = Timeout
107482026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
107492026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
107502026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107512026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107522026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
107532026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
107542026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
107552026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
107562026-10-29T02:50:33.727ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:40:33.727217586 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
107572026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
107582026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
107592026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
107602026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
107612026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
107622026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
107632026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 34 reason = Timeout
107642026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107652026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
107662026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
107672026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 32 reason = Timeout
107682026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 64 reason = Timeout
107692026-10-29T02:50:33.727ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
107702026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
107712026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 14.38\u{b5}s iteration = 32 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
107722026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
107732026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 30 reason = Timeout
107742026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
107752026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
107762026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107772026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
107782026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
107792026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
107802026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
107812026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107822026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107832026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107842026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
107852026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107862026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107872026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
107882026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
107892026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
107902026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
107912026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
107922026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
107932026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
107942026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107952026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
107962026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107972026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
107982026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
107992026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
108002026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108012026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
108022026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
108032026-10-29T02:50:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 406225401 } })
108042026-10-29T02:50:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 406228491 } })
108052026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
108062026-10-29T02:50:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 406257702 } })
108072026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
108082026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
108092026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
108102026-10-29T02:50:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 406318183 } })
108112026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108122026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
108132026-10-29T02:50:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "546af41c-9259-4c4f-88ae-affd7470e6bd", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108142026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108152026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
108162026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0453b51c-bd1a-4150-becf-47d0cb7efd77", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108172026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108182026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108192026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 759.245\u{b5}s iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108202026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c337024e-d2b4-4b7b-8914-adc93bcff0b6", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108212026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108222026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "43f538d0-ee2d-444d-b232-47bec963e42b", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108232026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108242026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4dbd0821-115d-4a52-9d55-1a51dad1ae74", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108252026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108262026-10-29T02:50:33.728ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108272026-10-29T02:50:33.728ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 406499467 } })
108282026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.141094ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108292026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
108302026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
108312026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
108322026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.325337ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
108332026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
108342026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.258756ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
108352026-10-29T02:50:33.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
108362026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.967291ms iteration = 25 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
108372026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa11abb0-7ebc-4235-a12d-970a37e6978c", "content-length": "50", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} })
108382026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7b7917-3ecc-4ea0-88c1-f3768e615ea0", "content-length": "50", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} })
108392026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108402026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
108412026-10-29T02:50:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
108422026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "b49753c2-1f4d-43d1-895c-597148c48336", "content-length": "681", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} })
108432026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
108442026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
108452026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
108462026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
108472026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
108482026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
108492026-10-29T02:50:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
108502026-10-29T02:50:33.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108512026-10-29T02:50:33.730ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108522026-10-29T02:50:33.730ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108532026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108542026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108552026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108562026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108572026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.563245ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
108582026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 13 reason = Timeout
108592026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
108602026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
108612026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108622026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
108632026-10-29T02:50:33.731ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
108642026-10-29T02:50:33.731ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
108652026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
108662026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
108672026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108682026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
108692026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108702026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108712026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.486454ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108722026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108732026-10-29T02:50:33.732ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 410817537 } })
108742026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
108752026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108762026-10-29T02:50:33.732ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
108772026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108782026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.436233ms iteration = 13 status = {"by_rx":{},"error":null}
108792026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108802026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
108812026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
108822026-10-29T02:50:33.732ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:40:33.727217586 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
108832026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.591896ms iteration = 13 status = {"expiration":"2026-10-29T02:40:33.727217586Z","pruned":[]}
108842026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108852026-10-29T02:50:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108862026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108872026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108882026-10-29T02:50:33.733ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
108892026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108902026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 6.404753ms iteration = 25 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
108912026-10-29T02:50:33.733ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108922026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108932026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108942026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108952026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108962026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108972026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
108982026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108992026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109002026-10-29T02:50:33.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109012026-10-29T02:50:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109022026-10-29T02:50:33.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109032026-10-29T02:50:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109042026-10-29T02:50:33.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109052026-10-29T02:50:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109062026-10-29T02:50:33.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109072026-10-29T02:50:33.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109082026-10-29T02:50:33.736ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109092026-10-29T02:50:33.736ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109102026-10-29T02:50:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109112026-10-29T02:50:33.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109122026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
109132026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
109142026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
109152026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
109162026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
109172026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
109182026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
109192026-10-29T02:50:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
109202026-10-29T02:50:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
109212026-10-29T02:50:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
109222026-10-29T02:50:33.742ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
109232026-10-29T02:50:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
109242026-10-29T02:50:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109252026-10-29T02:50:33.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109262026-10-29T02:50:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
109272026-10-29T02:50:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109282026-10-29T02:50:33.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109292026-10-29T02:50:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109302026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109312026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109322026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109332026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109342026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
109352026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
109362026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109372026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
109382026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
109392026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
109402026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
109412026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
109422026-10-29T02:50:33.746ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
109432026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
109442026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
109452026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
109462026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
109472026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
109482026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109492026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109502026-10-29T02:50:33.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
109512026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
109522026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
109532026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
109542026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109552026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109562026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109572026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
109582026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109592026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
109602026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
109612026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109622026-10-29T02:50:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
109632026-10-29T02:50:33.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109642026-10-29T02:50:33.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109652026-10-29T02:50:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109662026-10-29T02:50:33.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109672026-10-29T02:50:33.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109682026-10-29T02:50:33.754ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109692026-10-29T02:50:33.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109702026-10-29T02:50:33.760ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
109712026-10-29T02:50:33.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
109722026-10-29T02:50:33.769ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109732026-10-29T02:50:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109742026-10-29T02:50:33.774ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109752026-10-29T02:50:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109762026-10-29T02:50:33.787ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 60.241342ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
109772026-10-29T02:50:33.787ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109782026-10-29T02:50:33.787ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109792026-10-29T02:50:33.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109802026-10-29T02:50:33.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
109812026-10-29T02:50:33.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109822026-10-29T02:50:33.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109832026-10-29T02:50:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109842026-10-29T02:50:33.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109852026-10-29T02:50:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109862026-10-29T02:50:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
109872026-10-29T02:50:33.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109882026-10-29T02:50:33.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109892026-10-29T02:50:33.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109902026-10-29T02:50:33.812ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109912026-10-29T02:50:33.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109922026-10-29T02:50:33.816ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109932026-10-29T02:50:33.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109942026-10-29T02:50:33.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
109952026-10-29T02:50:33.821ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
109962026-10-29T02:50:33.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
109972026-10-29T02:50:33.857ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109982026-10-29T02:50:33.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
109992026-10-29T02:50:33.862ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
110002026-10-29T02:50:33.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
110012026-10-29T02:50:33.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110022026-10-29T02:50:33.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
110032026-10-29T02:50:33.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
110042026-10-29T02:50:33.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
110052026-10-29T02:50:33.878ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
110062026-10-29T02:50:33.878ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
110072026-10-29T02:50:33.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110082026-10-29T02:50:33.882ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
110092026-10-29T02:50:33.882ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
110102026-10-29T02:50:33.882ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 155.481401ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
110112026-10-29T02:50:33.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
110122026-10-29T02:50:33.884ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
110132026-10-29T02:50:33.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
110142026-10-29T02:50:33.885ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110152026-10-29T02:50:33.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110162026-10-29T02:50:33.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110172026-10-29T02:50:33.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110182026-10-29T02:50:33.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
110192026-10-29T02:50:33.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110202026-10-29T02:50:33.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
110212026-10-29T02:50:33.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
110222026-10-29T02:50:33.888ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
110232026-10-29T02:50:33.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110242026-10-29T02:50:33.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
110252026-10-29T02:50:33.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
110262026-10-29T02:50:33.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110272026-10-29T02:50:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110282026-10-29T02:50:33.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110292026-10-29T02:50:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110302026-10-29T02:50:33.894ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
110312026-10-29T02:50:33.894ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 167.170354ms iteration = 49 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
110322026-10-29T02:50:33.895ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 original_time_started = 2026-10-29 02:49:35.362411 UTC
110332026-10-29T02:50:33.896ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 168.783138ms iteration = 64 status = {"Loaded":{"collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","time_loaded":"2026-10-29T02:50:33.727272837Z","time_started":"2026-10-29T02:49:35.362411Z"}}
110342026-10-29T02:50:33.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110352026-10-29T02:50:33.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110362026-10-29T02:50:33.899ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 172.060117ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
110372026-10-29T02:50:33.903ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
110382026-10-29T02:50:33.903ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 176.370106ms iteration = 145 status = {"config_updated":false}
110392026-10-29T02:50:33.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 176.897147ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
110402026-10-29T02:50:33.904ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
110412026-10-29T02:50:33.904ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 177.127191ms iteration = 51 status = {"Loaded":{"time_loaded":"2026-10-29T02:50:33.727104954Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
110422026-10-29T02:50:33.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110432026-10-29T02:50:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 180.338208ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110442026-10-29T02:50:33.908ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 176.331425ms iteration = 13 status = {"samples_queued":6}
110452026-10-29T02:50:33.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110462026-10-29T02:50:33.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110472026-10-29T02:50:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110482026-10-29T02:50:33.917ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 185.26705ms iteration = 6 status = {"nsuccess":5}
110492026-10-29T02:50:33.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
110502026-10-29T02:50:33.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
110512026-10-29T02:50:33.937ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110522026-10-29T02:50:33.937ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110532026-10-29T02:50:33.937ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110542026-10-29T02:50:33.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 210.626978ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110552026-10-29T02:50:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
110562026-10-29T02:50:33.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
110572026-10-29T02:50:33.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
110582026-10-29T02:50:33.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110592026-10-29T02:50:33.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 227.273994ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
110602026-10-29T02:50:33.956ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
110612026-10-29T02:50:33.956ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
110622026-10-29T02:50:33.956ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
110632026-10-29T02:50:33.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110642026-10-29T02:50:33.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110652026-10-29T02:50:33.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110662026-10-29T02:50:33.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
110672026-10-29T02:50:33.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110682026-10-29T02:50:33.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
110692026-10-29T02:50:33.962ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110702026-10-29T02:50:33.962ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110712026-10-29T02:50:33.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110722026-10-29T02:50:33.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110732026-10-29T02:50:33.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
110742026-10-29T02:50:33.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110752026-10-29T02:50:33.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
110762026-10-29T02:50:33.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = instance_watcher body = None method = GET operation_id = vmm_get_state uri = http://[fd00:1122:3344:101::1]:12345/vmms/8a67a987-f063-4393-afb4-2e2a36429463/state
110772026-10-29T02:50:33.989ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110782026-10-29T02:50:33.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110792026-10-29T02:50:33.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "24ad5d05-475e-4dac-b51c-b978bb51b4a8", "content-length": "617", "date": "Thu, 29 Oct 2026 02:50:33 GMT"} })
110802026-10-29T02:50:33.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110812026-10-29T02:50:33.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110822026-10-29T02:50:33.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110832026-10-29T02:50:33.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110842026-10-29T02:50:33.997ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
110852026-10-29T02:50:33.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110862026-10-29T02:50:34.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
110872026-10-29T02:50:34.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
110882026-10-29T02:50:34.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 273.550896ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110892026-10-29T02:50:34.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
110902026-10-29T02:50:34.001ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
110912026-10-29T02:50:34.001ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
110922026-10-29T02:50:34.001ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
110932026-10-29T02:50:34.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110942026-10-29T02:50:34.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110952026-10-29T02:50:34.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110962026-10-29T02:50:34.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110972026-10-29T02:50:34.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110982026-10-29T02:50:34.011ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
110992026-10-29T02:50:34.014ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
111002026-10-29T02:50:34.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111012026-10-29T02:50:34.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
111022026-10-29T02:50:34.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111032026-10-29T02:50:34.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111042026-10-29T02:50:34.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111052026-10-29T02:50:34.041ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111062026-10-29T02:50:34.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
111072026-10-29T02:50:34.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
111082026-10-29T02:50:34.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
111092026-10-29T02:50:34.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
111102026-10-29T02:50:34.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111112026-10-29T02:50:34.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
111122026-10-29T02:50:34.049ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
111132026-10-29T02:50:34.049ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 322.062024ms iteration = 13 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
111142026-10-29T02:50:34.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111152026-10-29T02:50:34.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111162026-10-29T02:50:34.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111172026-10-29T02:50:34.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111182026-10-29T02:50:34.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111192026-10-29T02:50:34.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111202026-10-29T02:50:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111212026-10-29T02:50:34.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111222026-10-29T02:50:34.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111232026-10-29T02:50:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111242026-10-29T02:50:34.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111252026-10-29T02:50:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
111262026-10-29T02:50:34.067ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
111272026-10-29T02:50:34.067ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
111282026-10-29T02:50:34.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111292026-10-29T02:50:34.067ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d16d1d3-df2d-435e-afdd-0b8b3130c3e7", "content-length": "81", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
111302026-10-29T02:50:34.072ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
111312026-10-29T02:50:34.073ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111322026-10-29T02:50:34.073ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
111332026-10-29T02:50:34.073ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 341.722723ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111342026-10-29T02:50:34.073ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
111352026-10-29T02:50:34.073ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111362026-10-29T02:50:34.074ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
111372026-10-29T02:50:34.074ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
111382026-10-29T02:50:34.076ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "19045341-1d63-42c1-a5af-66c08e9ffc90", "content-length": "81", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
111392026-10-29T02:50:34.076ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
111402026-10-29T02:50:34.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111412026-10-29T02:50:34.079ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111422026-10-29T02:50:34.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
111432026-10-29T02:50:34.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111442026-10-29T02:50:34.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
111452026-10-29T02:50:34.087ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 361.151197ms iteration = 44 status = {"disks_added":0,"errors":[]}
111462026-10-29T02:50:34.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 360.986773ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111472026-10-29T02:50:34.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111482026-10-29T02:50:34.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111492026-10-29T02:50:34.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
111502026-10-29T02:50:34.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 366.59403ms iteration = 73 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
111512026-10-29T02:50:34.097ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
111522026-10-29T02:50:34.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
111532026-10-29T02:50:34.103ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
111542026-10-29T02:50:34.103ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
111552026-10-29T02:50:34.104ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed65a501-fc06-45d3-ad27-594a5587b600", "content-length": "81", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
111562026-10-29T02:50:34.104ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
111572026-10-29T02:50:34.104ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 377.793392ms iteration = 25 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
111582026-10-29T02:50:34.123ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
111592026-10-29T02:50:34.123ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 802180741 } })
111602026-10-29T02:50:34.125ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 398.657937ms iteration = 13 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
111612026-10-29T02:50:34.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111622026-10-29T02:50:34.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111632026-10-29T02:50:34.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111642026-10-29T02:50:34.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111652026-10-29T02:50:34.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111662026-10-29T02:50:34.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111672026-10-29T02:50:34.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111682026-10-29T02:50:34.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111692026-10-29T02:50:34.188ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
111702026-10-29T02:50:34.188ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
111712026-10-29T02:50:34.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111722026-10-29T02:50:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111732026-10-29T02:50:34.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111742026-10-29T02:50:34.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111752026-10-29T02:50:34.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111762026-10-29T02:50:34.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111772026-10-29T02:50:34.204ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
111782026-10-29T02:50:34.204ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
111792026-10-29T02:50:34.204ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
111802026-10-29T02:50:34.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 477.171578ms iteration = 13 status = {"generation":2}
111812026-10-29T02:50:34.206ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {aa8cdb86-5f5a-49c5-9626-b22e205075da: {10.151.2.175: {a3f7f6f0-b81d-4af7-8e61-22edc8607335}, 10.151.2.176: {a3f7f6f0-b81d-4af7-8e61-22edc8607335}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
111822026-10-29T02:50:34.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111832026-10-29T02:50:34.206ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0659dc77-80a0-46d9-9c7a-95a0665c835c", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
111842026-10-29T02:50:34.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111852026-10-29T02:50:34.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111862026-10-29T02:50:34.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
111872026-10-29T02:50:34.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
111882026-10-29T02:50:34.209ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
111892026-10-29T02:50:34.209ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 482.733264ms iteration = 35 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
111902026-10-29T02:50:34.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111912026-10-29T02:50:34.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111922026-10-29T02:50:34.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111932026-10-29T02:50:34.214ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
111942026-10-29T02:50:34.214ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 487.700268ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
111952026-10-29T02:50:34.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111962026-10-29T02:50:34.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111972026-10-29T02:50:34.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111982026-10-29T02:50:34.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111992026-10-29T02:50:34.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
112002026-10-29T02:50:34.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
112012026-10-29T02:50:34.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
112022026-10-29T02:50:34.221ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
112032026-10-29T02:50:34.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
112042026-10-29T02:50:34.225ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
112052026-10-29T02:50:34.225ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
112062026-10-29T02:50:34.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112072026-10-29T02:50:34.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112082026-10-29T02:50:34.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112092026-10-29T02:50:34.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112102026-10-29T02:50:34.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112112026-10-29T02:50:34.230ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
112122026-10-29T02:50:34.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
112132026-10-29T02:50:34.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112142026-10-29T02:50:34.234ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112152026-10-29T02:50:34.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112162026-10-29T02:50:34.234ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
112172026-10-29T02:50:34.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112182026-10-29T02:50:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
112192026-10-29T02:50:34.237ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112202026-10-29T02:50:34.239ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
112212026-10-29T02:50:34.239ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
112222026-10-29T02:50:34.239ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
112232026-10-29T02:50:34.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 507.983589ms iteration = 13 status = {"generation":1}
112242026-10-29T02:50:34.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112252026-10-29T02:50:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112262026-10-29T02:50:34.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
112272026-10-29T02:50:34.243ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
112282026-10-29T02:50:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
112292026-10-29T02:50:34.244ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
112302026-10-29T02:50:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
112312026-10-29T02:50:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
112322026-10-29T02:50:34.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112332026-10-29T02:50:34.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112342026-10-29T02:50:34.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112352026-10-29T02:50:34.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 523.231825ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
112362026-10-29T02:50:34.252ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
112372026-10-29T02:50:34.252ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 525.37908ms iteration = 37 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
112382026-10-29T02:50:34.254ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
112392026-10-29T02:50:34.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112402026-10-29T02:50:34.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112412026-10-29T02:50:34.255ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
112422026-10-29T02:50:34.257ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
112432026-10-29T02:50:34.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112442026-10-29T02:50:34.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112452026-10-29T02:50:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112462026-10-29T02:50:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
112472026-10-29T02:50:34.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
112482026-10-29T02:50:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
112492026-10-29T02:50:34.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112502026-10-29T02:50:34.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112512026-10-29T02:50:34.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112522026-10-29T02:50:34.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
112532026-10-29T02:50:34.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "3a1427e6-10dd-48b1-bc2e-9ea352bf7137", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
112542026-10-29T02:50:34.264ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
112552026-10-29T02:50:34.264ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
112562026-10-29T02:50:34.264ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 537.999912ms iteration = 13 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
112572026-10-29T02:50:34.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112582026-10-29T02:50:34.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112592026-10-29T02:50:34.269ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
112602026-10-29T02:50:34.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112612026-10-29T02:50:34.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112622026-10-29T02:50:34.270ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
112632026-10-29T02:50:34.272ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
112642026-10-29T02:50:34.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
112652026-10-29T02:50:34.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112662026-10-29T02:50:34.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
112672026-10-29T02:50:34.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
112682026-10-29T02:50:34.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112692026-10-29T02:50:34.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112702026-10-29T02:50:34.284ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
112712026-10-29T02:50:34.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112722026-10-29T02:50:34.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112732026-10-29T02:50:34.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
112742026-10-29T02:50:34.285ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
112752026-10-29T02:50:34.287ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
112762026-10-29T02:50:34.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112772026-10-29T02:50:34.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
112782026-10-29T02:50:34.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
112792026-10-29T02:50:34.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112802026-10-29T02:50:34.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112812026-10-29T02:50:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
112822026-10-29T02:50:34.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112832026-10-29T02:50:34.296ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
112842026-10-29T02:50:34.297ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
112852026-10-29T02:50:34.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3d21c55-3871-41df-ad26-6e2613bd5dfd", "content-length": "936", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
112862026-10-29T02:50:34.297ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: fd9f:e804:e0a0::5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5665228) }, VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5665228) }} sled = sock
112872026-10-29T02:50:34.297ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
112882026-10-29T02:50:34.297ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
112892026-10-29T02:50:34.297ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 565.79192ms iteration = 25 status = {}
112902026-10-29T02:50:34.299ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
112912026-10-29T02:50:34.301ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
112922026-10-29T02:50:34.302ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = SledList step id = Fetch
112932026-10-29T02:50:34.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
112942026-10-29T02:50:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
112952026-10-29T02:50:34.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112962026-10-29T02:50:34.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
112972026-10-29T02:50:34.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
112982026-10-29T02:50:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
112992026-10-29T02:50:34.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113002026-10-29T02:50:34.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
113012026-10-29T02:50:34.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
113022026-10-29T02:50:34.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
113032026-10-29T02:50:34.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113042026-10-29T02:50:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113052026-10-29T02:50:34.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113062026-10-29T02:50:34.355ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113072026-10-29T02:50:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113082026-10-29T02:50:34.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
113092026-10-29T02:50:34.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113102026-10-29T02:50:34.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113112026-10-29T02:50:34.359ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113122026-10-29T02:50:34.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113132026-10-29T02:50:34.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113142026-10-29T02:50:34.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
113152026-10-29T02:50:34.363ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113162026-10-29T02:50:34.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113172026-10-29T02:50:34.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113182026-10-29T02:50:34.367ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113192026-10-29T02:50:34.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113202026-10-29T02:50:34.370ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113212026-10-29T02:50:34.372ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
113222026-10-29T02:50:34.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113232026-10-29T02:50:34.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113242026-10-29T02:50:34.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113252026-10-29T02:50:34.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113262026-10-29T02:50:34.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
113272026-10-29T02:50:34.375ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113282026-10-29T02:50:34.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113292026-10-29T02:50:34.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113302026-10-29T02:50:34.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113312026-10-29T02:50:34.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113322026-10-29T02:50:34.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113332026-10-29T02:50:34.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113342026-10-29T02:50:34.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: a878a4b9-bef9-4f8d-b405-9dcaf3650934, lookup_type: ById(a878a4b9-bef9-4f8d-b405-9dcaf3650934) }, key: b2e3d481-3b3d-41ea-b204-1accedf058bf (project), lookup_type: ById(b2e3d481-3b3d-41ea-b204-1accedf058bf) }, key: fa034a1b-b816-4e09-aae9-162d9a77af23, lookup_type: ById(fa034a1b-b816-4e09-aae9-162d9a77af23) }, key: 16e2c4a6-82e8-4574-9f84-3d515ed30270, lookup_type: ById(16e2c4a6-82e8-4574-9f84-3d515ed30270) } result = Ok(())
113352026-10-29T02:50:34.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113362026-10-29T02:50:34.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113372026-10-29T02:50:34.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113382026-10-29T02:50:34.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113392026-10-29T02:50:34.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113402026-10-29T02:50:34.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113412026-10-29T02:50:34.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113422026-10-29T02:50:34.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113432026-10-29T02:50:34.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113442026-10-29T02:50:34.407ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
113452026-10-29T02:50:34.407ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 680.606086ms iteration = 25 status = {"incomplete_bootstore_configs":[]}
113462026-10-29T02:50:34.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: a878a4b9-bef9-4f8d-b405-9dcaf3650934, lookup_type: ById(a878a4b9-bef9-4f8d-b405-9dcaf3650934) }, key: b2e3d481-3b3d-41ea-b204-1accedf058bf (project), lookup_type: ById(b2e3d481-3b3d-41ea-b204-1accedf058bf) }, key: fa034a1b-b816-4e09-aae9-162d9a77af23, lookup_type: ById(fa034a1b-b816-4e09-aae9-162d9a77af23) }, key: 16e2c4a6-82e8-4574-9f84-3d515ed30270, lookup_type: ById(16e2c4a6-82e8-4574-9f84-3d515ed30270) } result = Ok(())
113472026-10-29T02:50:34.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113482026-10-29T02:50:34.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113492026-10-29T02:50:34.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113502026-10-29T02:50:34.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113512026-10-29T02:50:34.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113522026-10-29T02:50:34.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113532026-10-29T02:50:34.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113542026-10-29T02:50:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113552026-10-29T02:50:34.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113562026-10-29T02:50:34.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113572026-10-29T02:50:34.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113582026-10-29T02:50:34.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113592026-10-29T02:50:34.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113602026-10-29T02:50:34.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113612026-10-29T02:50:34.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113622026-10-29T02:50:34.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113632026-10-29T02:50:34.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113642026-10-29T02:50:34.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: a878a4b9-bef9-4f8d-b405-9dcaf3650934, lookup_type: ById(a878a4b9-bef9-4f8d-b405-9dcaf3650934) }, key: b2e3d481-3b3d-41ea-b204-1accedf058bf (project), lookup_type: ById(b2e3d481-3b3d-41ea-b204-1accedf058bf) }, key: fa034a1b-b816-4e09-aae9-162d9a77af23, lookup_type: ById(fa034a1b-b816-4e09-aae9-162d9a77af23) }, key: 5b59f983-eb82-4ca2-b8e2-95cc6446b47c, lookup_type: ById(5b59f983-eb82-4ca2-b8e2-95cc6446b47c) } result = Ok(())
113652026-10-29T02:50:34.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113662026-10-29T02:50:34.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113672026-10-29T02:50:34.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113682026-10-29T02:50:34.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113692026-10-29T02:50:34.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113702026-10-29T02:50:34.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113712026-10-29T02:50:34.464ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113722026-10-29T02:50:34.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113732026-10-29T02:50:34.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113742026-10-29T02:50:34.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113752026-10-29T02:50:34.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113762026-10-29T02:50:34.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113772026-10-29T02:50:34.466ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113782026-10-29T02:50:34.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113792026-10-29T02:50:34.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
113802026-10-29T02:50:34.470ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113812026-10-29T02:50:34.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113822026-10-29T02:50:34.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113832026-10-29T02:50:34.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113842026-10-29T02:50:34.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113852026-10-29T02:50:34.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113862026-10-29T02:50:34.475ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
113872026-10-29T02:50:34.475ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
113882026-10-29T02:50:34.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
113892026-10-29T02:50:34.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113902026-10-29T02:50:34.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
113912026-10-29T02:50:34.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113922026-10-29T02:50:34.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113932026-10-29T02:50:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113942026-10-29T02:50:34.479ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113952026-10-29T02:50:34.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
113962026-10-29T02:50:34.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113972026-10-29T02:50:34.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
113982026-10-29T02:50:34.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
113992026-10-29T02:50:34.482ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
114002026-10-29T02:50:34.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
114012026-10-29T02:50:34.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114022026-10-29T02:50:34.488ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
114032026-10-29T02:50:34.488ZINFOnexus (BackgroundTasks): building sitrep 984d58e7-5944-4cbf-97ff-ccbb133b46d1 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 984d58e7-5944-4cbf-97ff-ccbb133b46d1 (sitrep)
114042026-10-29T02:50:34.488ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
114052026-10-29T02:50:34.488ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 761.014497ms iteration = 30 status = {"inv_collection_id":"9a3e2159-904d-4a43-ad6f-208498b145f0","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:50:34.488261934Z","outcome":"Unchanged","start_time":"2026-10-29T02:50:34.488196613Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
114062026-10-29T02:50:34.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: a878a4b9-bef9-4f8d-b405-9dcaf3650934, lookup_type: ById(a878a4b9-bef9-4f8d-b405-9dcaf3650934) }, key: b2e3d481-3b3d-41ea-b204-1accedf058bf (project), lookup_type: ById(b2e3d481-3b3d-41ea-b204-1accedf058bf) }, key: fa034a1b-b816-4e09-aae9-162d9a77af23, lookup_type: ById(fa034a1b-b816-4e09-aae9-162d9a77af23) }, key: 5b59f983-eb82-4ca2-b8e2-95cc6446b47c, lookup_type: ByName("default") } result = Ok(())
114072026-10-29T02:50:34.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114082026-10-29T02:50:34.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
114092026-10-29T02:50:34.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
114102026-10-29T02:50:34.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
114112026-10-29T02:50:34.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114122026-10-29T02:50:34.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114132026-10-29T02:50:34.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114142026-10-29T02:50:34.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114152026-10-29T02:50:34.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114162026-10-29T02:50:34.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114172026-10-29T02:50:34.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114182026-10-29T02:50:34.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114192026-10-29T02:50:34.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114202026-10-29T02:50:34.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114212026-10-29T02:50:34.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114222026-10-29T02:50:34.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114232026-10-29T02:50:34.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114242026-10-29T02:50:34.512ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
114252026-10-29T02:50:34.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 785.315892ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
114262026-10-29T02:50:34.512ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = DeployNexusRecords step id = Ensure
114272026-10-29T02:50:34.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114282026-10-29T02:50:34.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114292026-10-29T02:50:34.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114302026-10-29T02:50:34.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114312026-10-29T02:50:34.520ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
114322026-10-29T02:50:34.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114332026-10-29T02:50:34.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114342026-10-29T02:50:34.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114352026-10-29T02:50:34.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114362026-10-29T02:50:34.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: a878a4b9-bef9-4f8d-b405-9dcaf3650934, lookup_type: ById(a878a4b9-bef9-4f8d-b405-9dcaf3650934) }, key: b2e3d481-3b3d-41ea-b204-1accedf058bf (project), lookup_type: ById(b2e3d481-3b3d-41ea-b204-1accedf058bf) }, key: fa034a1b-b816-4e09-aae9-162d9a77af23, lookup_type: ById(fa034a1b-b816-4e09-aae9-162d9a77af23) }, key: a3f7f6f0-b81d-4af7-8e61-22edc8607335, lookup_type: ByName("default") } result = Ok(())
114372026-10-29T02:50:34.524ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114382026-10-29T02:50:34.524ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114392026-10-29T02:50:34.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5184ace4-6387-4f5d-8ef9-52d582505151", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
114402026-10-29T02:50:34.524ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 797.948446ms iteration = 37 status = {}
114412026-10-29T02:50:34.524ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 38 reason = Dependency
114422026-10-29T02:50:34.524ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114432026-10-29T02:50:34.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114442026-10-29T02:50:34.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114452026-10-29T02:50:34.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114462026-10-29T02:50:34.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114472026-10-29T02:50:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
114482026-10-29T02:50:34.532ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114492026-10-29T02:50:34.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114502026-10-29T02:50:34.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114512026-10-29T02:50:34.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114522026-10-29T02:50:34.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114532026-10-29T02:50:34.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114542026-10-29T02:50:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114552026-10-29T02:50:34.545ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114562026-10-29T02:50:34.546ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114572026-10-29T02:50:34.546ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "435d31d8-5232-4d07-b1a0-7f6fc1285e04", "content-length": "677", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
114582026-10-29T02:50:34.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114592026-10-29T02:50:34.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114602026-10-29T02:50:34.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
114612026-10-29T02:50:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
114622026-10-29T02:50:34.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114632026-10-29T02:50:34.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
114642026-10-29T02:50:34.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
114652026-10-29T02:50:34.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
114662026-10-29T02:50:34.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
114672026-10-29T02:50:34.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
114682026-10-29T02:50:34.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
114692026-10-29T02:50:34.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
114702026-10-29T02:50:34.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114712026-10-29T02:50:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
114722026-10-29T02:50:34.619ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = SledAgent step id = Ensure
114732026-10-29T02:50:34.619ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
114742026-10-29T02:50:34.622ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "0ee40338-47fd-4cf0-bd4c-ccb3e762b469", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
114752026-10-29T02:50:34.622ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = FirewallRules step id = Ensure
114762026-10-29T02:50:34.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114772026-10-29T02:50:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114782026-10-29T02:50:34.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114792026-10-29T02:50:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114802026-10-29T02:50:34.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114812026-10-29T02:50:34.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114822026-10-29T02:50:34.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114832026-10-29T02:50:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114842026-10-29T02:50:34.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114852026-10-29T02:50:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114862026-10-29T02:50:34.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114872026-10-29T02:50:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114882026-10-29T02:50:34.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114892026-10-29T02:50:34.647ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {aa8cdb86-5f5a-49c5-9626-b22e205075da: {10.151.2.175: {a3f7f6f0-b81d-4af7-8e61-22edc8607335}, 10.151.2.176: {a3f7f6f0-b81d-4af7-8e61-22edc8607335}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
114902026-10-29T02:50:34.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114912026-10-29T02:50:34.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
114922026-10-29T02:50:34.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
114932026-10-29T02:50:34.647ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2a0b877e-8a75-42ab-8ace-e3076011345f", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
114942026-10-29T02:50:34.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114952026-10-29T02:50:34.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
114962026-10-29T02:50:34.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
114972026-10-29T02:50:34.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114982026-10-29T02:50:34.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
114992026-10-29T02:50:34.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115002026-10-29T02:50:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115012026-10-29T02:50:34.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115022026-10-29T02:50:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115032026-10-29T02:50:34.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115042026-10-29T02:50:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115052026-10-29T02:50:34.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115062026-10-29T02:50:34.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115072026-10-29T02:50:34.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115082026-10-29T02:50:34.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115092026-10-29T02:50:34.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115102026-10-29T02:50:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115112026-10-29T02:50:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
115122026-10-29T02:50:34.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115132026-10-29T02:50:34.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115142026-10-29T02:50:34.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115152026-10-29T02:50:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115162026-10-29T02:50:34.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115172026-10-29T02:50:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115182026-10-29T02:50:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
115192026-10-29T02:50:34.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115202026-10-29T02:50:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115212026-10-29T02:50:34.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115222026-10-29T02:50:34.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115232026-10-29T02:50:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115242026-10-29T02:50:34.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115252026-10-29T02:50:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115262026-10-29T02:50:34.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115272026-10-29T02:50:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115282026-10-29T02:50:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
115292026-10-29T02:50:34.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115302026-10-29T02:50:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115312026-10-29T02:50:34.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115322026-10-29T02:50:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115332026-10-29T02:50:34.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115342026-10-29T02:50:34.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115352026-10-29T02:50:34.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115362026-10-29T02:50:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115372026-10-29T02:50:34.673ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115382026-10-29T02:50:34.673ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115392026-10-29T02:50:34.673ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115402026-10-29T02:50:34.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115412026-10-29T02:50:34.673ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "457f8616-50e0-4620-b60c-ffffb7968c66", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
115422026-10-29T02:50:34.673ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 148.957146ms iteration = 38 status = {}
115432026-10-29T02:50:34.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115442026-10-29T02:50:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115452026-10-29T02:50:34.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115462026-10-29T02:50:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115472026-10-29T02:50:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
115482026-10-29T02:50:34.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115492026-10-29T02:50:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115502026-10-29T02:50:34.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115512026-10-29T02:50:34.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115522026-10-29T02:50:34.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115532026-10-29T02:50:34.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115542026-10-29T02:50:34.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115552026-10-29T02:50:34.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115562026-10-29T02:50:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
115572026-10-29T02:50:34.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115582026-10-29T02:50:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115592026-10-29T02:50:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
115602026-10-29T02:50:34.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115612026-10-29T02:50:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115622026-10-29T02:50:34.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115632026-10-29T02:50:34.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115642026-10-29T02:50:34.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115652026-10-29T02:50:34.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
115662026-10-29T02:50:34.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115672026-10-29T02:50:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115682026-10-29T02:50:34.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115692026-10-29T02:50:34.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115702026-10-29T02:50:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115712026-10-29T02:50:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
115722026-10-29T02:50:34.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115732026-10-29T02:50:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115742026-10-29T02:50:34.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115752026-10-29T02:50:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115762026-10-29T02:50:34.701ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
115772026-10-29T02:50:34.701ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
115782026-10-29T02:50:34.701ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 4a0f19cf-8fde-4437-8c08-1cf6bb8cca70 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
115792026-10-29T02:50:34.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115802026-10-29T02:50:34.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115812026-10-29T02:50:34.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115822026-10-29T02:50:34.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115832026-10-29T02:50:34.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115842026-10-29T02:50:34.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115852026-10-29T02:50:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115862026-10-29T02:50:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
115872026-10-29T02:50:34.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
115882026-10-29T02:50:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
115892026-10-29T02:50:34.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115902026-10-29T02:50:34.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115912026-10-29T02:50:34.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115922026-10-29T02:50:34.712ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 2 limit = 5000 usage_percent = 0
115932026-10-29T02:50:34.712ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
115942026-10-29T02:50:34.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115952026-10-29T02:50:34.712ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 985.297329ms iteration = 34 status = {"Unchanged":{"blueprint_count":2,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
115962026-10-29T02:50:34.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
115972026-10-29T02:50:34.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
115982026-10-29T02:50:34.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115992026-10-29T02:50:34.723ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
116002026-10-29T02:50:34.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116012026-10-29T02:50:34.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116022026-10-29T02:50:34.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116032026-10-29T02:50:34.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116042026-10-29T02:50:34.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116052026-10-29T02:50:34.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116062026-10-29T02:50:34.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116072026-10-29T02:50:34.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
116082026-10-29T02:50:34.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116092026-10-29T02:50:34.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116102026-10-29T02:50:34.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116112026-10-29T02:50:34.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116122026-10-29T02:50:34.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116132026-10-29T02:50:34.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116142026-10-29T02:50:34.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116152026-10-29T02:50:34.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116162026-10-29T02:50:34.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116172026-10-29T02:50:34.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116182026-10-29T02:50:34.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116192026-10-29T02:50:34.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116202026-10-29T02:50:34.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116212026-10-29T02:50:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116222026-10-29T02:50:34.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116232026-10-29T02:50:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116242026-10-29T02:50:34.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116252026-10-29T02:50:34.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
116262026-10-29T02:50:34.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116272026-10-29T02:50:34.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116282026-10-29T02:50:34.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116292026-10-29T02:50:34.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116302026-10-29T02:50:34.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116312026-10-29T02:50:34.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116322026-10-29T02:50:34.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116332026-10-29T02:50:34.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
116342026-10-29T02:50:34.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116352026-10-29T02:50:34.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116362026-10-29T02:50:34.790ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
116372026-10-29T02:50:34.790ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
116382026-10-29T02:50:34.790ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
116392026-10-29T02:50:34.891ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
116402026-10-29T02:50:34.891ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
116412026-10-29T02:50:34.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116422026-10-29T02:50:34.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116432026-10-29T02:50:34.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116442026-10-29T02:50:34.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116452026-10-29T02:50:34.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116462026-10-29T02:50:34.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
116472026-10-29T02:50:34.904ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
116482026-10-29T02:50:34.905ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d9593cc3-d912-46a4-a26a-24c6f68e4b2f", "date": "Thu, 29 Oct 2026 02:50:34 GMT"} })
116492026-10-29T02:50:34.905ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
116502026-10-29T02:50:34.905ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = Dns step id = Ensure
116512026-10-29T02:50:34.905ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
116522026-10-29T02:50:34.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116532026-10-29T02:50:34.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116542026-10-29T02:50:34.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116552026-10-29T02:50:34.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116562026-10-29T02:50:34.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116572026-10-29T02:50:34.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
116582026-10-29T02:50:34.915ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
116592026-10-29T02:50:34.915ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
116602026-10-29T02:50:34.915ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
116612026-10-29T02:50:34.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116622026-10-29T02:50:34.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116632026-10-29T02:50:34.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116642026-10-29T02:50:34.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
116652026-10-29T02:50:34.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116662026-10-29T02:50:34.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116672026-10-29T02:50:34.980ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
116682026-10-29T02:50:34.980ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
116692026-10-29T02:50:34.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116702026-10-29T02:50:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116712026-10-29T02:50:34.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116722026-10-29T02:50:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
116732026-10-29T02:50:34.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116742026-10-29T02:50:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116752026-10-29T02:50:34.993ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
116762026-10-29T02:50:34.993ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
116772026-10-29T02:50:34.993ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
116782026-10-29T02:50:34.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116792026-10-29T02:50:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116802026-10-29T02:50:34.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116812026-10-29T02:50:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116822026-10-29T02:50:34.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116832026-10-29T02:50:35.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
116842026-10-29T02:50:35.073ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
116852026-10-29T02:50:35.073ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
116862026-10-29T02:50:35.073ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
116872026-10-29T02:50:35.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116882026-10-29T02:50:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116892026-10-29T02:50:35.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116902026-10-29T02:50:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
116912026-10-29T02:50:35.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116922026-10-29T02:50:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116932026-10-29T02:50:35.157ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
116942026-10-29T02:50:35.157ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
116952026-10-29T02:50:35.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
116962026-10-29T02:50:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
116972026-10-29T02:50:35.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116982026-10-29T02:50:35.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
116992026-10-29T02:50:35.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117002026-10-29T02:50:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117012026-10-29T02:50:35.169ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
117022026-10-29T02:50:35.169ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
117032026-10-29T02:50:35.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117042026-10-29T02:50:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117052026-10-29T02:50:35.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117062026-10-29T02:50:35.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
117072026-10-29T02:50:35.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117082026-10-29T02:50:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117092026-10-29T02:50:35.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117102026-10-29T02:50:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117112026-10-29T02:50:35.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117122026-10-29T02:50:35.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117132026-10-29T02:50:35.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117142026-10-29T02:50:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
117152026-10-29T02:50:35.192ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
117162026-10-29T02:50:35.192ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
117172026-10-29T02:50:35.192ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = OmicronZones step id = Cleanup
117182026-10-29T02:50:35.192ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = OmicronZones step id = Cleanup
117192026-10-29T02:50:35.192ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = PhysicalDisks step id = Cleanup
117202026-10-29T02:50:35.192ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = Clickhouse step id = Ensure
117212026-10-29T02:50:35.192ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = Clickhouse step id = Ensure
117222026-10-29T02:50:35.192ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
117232026-10-29T02:50:35.197ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "885359fc-ce95-4b76-8493-573c711f8c16", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117242026-10-29T02:50:35.197ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = SupportBundles step id = Cleanup
117252026-10-29T02:50:35.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117262026-10-29T02:50:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117272026-10-29T02:50:35.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117282026-10-29T02:50:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
117292026-10-29T02:50:35.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117302026-10-29T02:50:35.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117312026-10-29T02:50:35.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117322026-10-29T02:50:35.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117332026-10-29T02:50:35.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117342026-10-29T02:50:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
117352026-10-29T02:50:35.285ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = OmicronZones step id = Cleanup
117362026-10-29T02:50:35.285ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
117372026-10-29T02:50:35.285ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
117382026-10-29T02:50:35.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117392026-10-29T02:50:35.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117402026-10-29T02:50:35.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117412026-10-29T02:50:35.290ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
117422026-10-29T02:50:35.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117432026-10-29T02:50:35.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117442026-10-29T02:50:35.360ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
117452026-10-29T02:50:35.360ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
117462026-10-29T02:50:35.360ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = OmicronZones step id = Cleanup
117472026-10-29T02:50:35.360ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
117482026-10-29T02:50:35.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117492026-10-29T02:50:35.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117502026-10-29T02:50:35.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117512026-10-29T02:50:35.366ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
117522026-10-29T02:50:35.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117532026-10-29T02:50:35.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117542026-10-29T02:50:35.490ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
117552026-10-29T02:50:35.490ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = Cockroach step id = Ensure
117562026-10-29T02:50:35.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
117572026-10-29T02:50:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
117582026-10-29T02:50:35.499ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
117592026-10-29T02:50:35.500ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = c7dcfa09-ade7-4a68-8017-fbb1f7ebf686 step component = MgsUpdates step id = Ensure
117602026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 15 reason = Dependency
117612026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 38 reason = Dependency
117622026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117632026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117642026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.773531842s iteration = 14 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":2320,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":575385839,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":575385779,"secs":0}},"event_index":1,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":575396050,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":210064796,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":210064736,"secs":0}},"event_index":2,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":785484026,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":106747359,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":106747319,"secs":0}},"event_index":3,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":892257615,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3187256,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3187226,"secs":0}},"event_index":4,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":895464912,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":282712296,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":282712246,"secs":0}},"event_index":5,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":178188218,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":287285102,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":287285062,"secs":0}},"event_index":6,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":465483030,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":6650,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":6620,"secs":0}},"event_index":7,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":465503990,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2040,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2010,"secs":0}},"event_index":8,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":465508360,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3120,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3080,"secs":0}},"event_index":9,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":465514620,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3440,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":3400,"secs":0}},"event_index":10,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":465519531,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4893602,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":4893562,"secs":0}},"event_index":11,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":470414382,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":88073140,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":88073100,"secs":0}},"event_index":12,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":558498193,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":75395146,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":75395106,"secs":0}},"event_index":13,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":633917620,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":129909790,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":129909750,"secs":0}},"event_index":14,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":763840860,"secs":1}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":9236301,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":9236272,"secs":0}},"event_index":15,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":773092812,"secs":1}},{"data":{"attempt_elapsed":{"nanos":5670,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":5630,"secs":0}},"event_index":16,"execution_id":"c7dcfa09-ade7-4a68-8017-fbb1f7ebf686","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":773106143,"secs":1}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
117652026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
117662026-10-29T02:50:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117672026-10-29T02:50:35.502ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117682026-10-29T02:50:35.502ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117692026-10-29T02:50:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
117702026-10-29T02:50:35.505ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117712026-10-29T02:50:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
117722026-10-29T02:50:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
117732026-10-29T02:50:35.506ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117742026-10-29T02:50:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117752026-10-29T02:50:35.508ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117762026-10-29T02:50:35.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117772026-10-29T02:50:35.510ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117782026-10-29T02:50:35.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
117792026-10-29T02:50:35.513ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117802026-10-29T02:50:35.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117812026-10-29T02:50:35.537ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(cd4ebd71-78bc-4c03-9587-d5b137def4e0, 0), (63f32cdd-9518-4a2a-949d-5cfd979654cb, 0), (9a3e2159-904d-4a43-ad6f-208498b145f0, 0)]
117822026-10-29T02:50:35.537ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1397, tv_nsec: 216178770 } })
117832026-10-29T02:50:35.539ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1397, tv_nsec: 217412836 } })
117842026-10-29T02:50:35.539ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
117852026-10-29T02:50:35.539ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
117862026-10-29T02:50:35.539ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
117872026-10-29T02:50:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0d4f3dd-a1d0-4555-8a4e-8edd5103c317", "content-length": "50", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117882026-10-29T02:50:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
117892026-10-29T02:50:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cf42921-7ee9-4076-8b68-eec648cc4c6b", "content-length": "681", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117902026-10-29T02:50:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
117912026-10-29T02:50:35.540ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1866a1c-71c7-426e-9892-deaa0a15aede", "content-length": "734", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117922026-10-29T02:50:35.540ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
117932026-10-29T02:50:35.541ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50d5746-ab0f-49ea-b903-c2ec1d34ac4b", "content-length": "111", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117942026-10-29T02:50:35.541ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
117952026-10-29T02:50:35.542ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c74b7a96-7d30-43af-b8de-bb9420f2bfec", "content-length": "111", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117962026-10-29T02:50:35.542ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
117972026-10-29T02:50:35.543ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "094e3b2e-8369-41fe-afe2-a2fdf11eb9de", "content-length": "163", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
117982026-10-29T02:50:35.543ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
117992026-10-29T02:50:35.544ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "17a7a0c8-28f2-4b9b-b843-7841f3615b9c", "content-length": "163", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118002026-10-29T02:50:35.544ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
118012026-10-29T02:50:35.544ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f918493c-0ec0-467f-b5c9-e98ffa19b7cc", "content-length": "166", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118022026-10-29T02:50:35.544ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
118032026-10-29T02:50:35.545ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e5aef3b-4d90-4675-809a-ad4ab8b1ce1b", "content-length": "166", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118042026-10-29T02:50:35.545ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
118052026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72ad175-87d3-40d2-bd51-a5e287a1677e", "content-length": "702", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118062026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
118072026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9341d7d-4181-407c-99f2-99f957eac6e4", "content-length": "727", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118082026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
118092026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd5edcf2-1c96-4b4f-9c87-5053deeb891f", "content-length": "729", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118102026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
118112026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5055b890-b3d0-41f2-887a-56422d19cb6d", "content-length": "728", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118122026-10-29T02:50:35.546ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
118132026-10-29T02:50:35.547ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "77d7b934-a41d-40ad-a1f8-970cbcc7901e", "content-length": "722", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118142026-10-29T02:50:35.547ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
118152026-10-29T02:50:35.547ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "d796e9ad-e77c-4533-8dca-c00ff50931e0", "content-length": "10", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118162026-10-29T02:50:35.547ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
118172026-10-29T02:50:35.547ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f87ebdd-cd1b-4d42-917e-8cc3be52eb4f", "content-length": "144", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118182026-10-29T02:50:35.547ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
118192026-10-29T02:50:35.548ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c1f7d10-dd6f-4c34-9ecd-8f92009c6bc9", "content-length": "147", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118202026-10-29T02:50:35.548ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
118212026-10-29T02:50:35.548ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "705401e5-b6c0-4c2d-af0a-66f7d81db718", "content-length": "109", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118222026-10-29T02:50:35.548ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
118232026-10-29T02:50:35.549ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8365d491-d911-41ad-b771-815dce7fe1ca", "content-length": "109", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118242026-10-29T02:50:35.549ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
118252026-10-29T02:50:35.549ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d529700a-194b-4d86-9605-eee3b0440e38", "content-length": "163", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118262026-10-29T02:50:35.549ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
118272026-10-29T02:50:35.550ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdc78979-637c-4ad4-bc2f-4413e90a13ba", "content-length": "163", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118282026-10-29T02:50:35.550ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
118292026-10-29T02:50:35.551ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "87a41b4f-e705-443b-97de-6d1dc0bac390", "content-length": "166", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118302026-10-29T02:50:35.551ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
118312026-10-29T02:50:35.552ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ced3bbd-6a99-4a6c-90b2-ca4a5bce8c83", "content-length": "166", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118322026-10-29T02:50:35.552ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
118332026-10-29T02:50:35.553ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "60a1fb0d-023e-4f2a-8a60-f6cf3ee0a75f", "content-length": "702", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118342026-10-29T02:50:35.553ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
118352026-10-29T02:50:35.553ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ac39b0c-864d-4425-b5df-c3ac96dd71f6", "content-length": "727", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118362026-10-29T02:50:35.553ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
118372026-10-29T02:50:35.553ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "040eabda-fce1-450b-b8a8-218113225af7", "content-length": "729", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118382026-10-29T02:50:35.554ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
118392026-10-29T02:50:35.554ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce043b67-1f14-4279-b452-b9148604c8f0", "content-length": "728", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118402026-10-29T02:50:35.554ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
118412026-10-29T02:50:35.554ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac26a88a-4af0-4eed-a85c-2e0506769f44", "content-length": "722", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118422026-10-29T02:50:35.554ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
118432026-10-29T02:50:35.555ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "d51e2fb0-a878-4721-908a-588f0de03470", "content-length": "10", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118442026-10-29T02:50:35.555ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
118452026-10-29T02:50:35.555ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "befe3dd7-8260-4b8e-8df7-4c29748856db", "content-length": "144", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118462026-10-29T02:50:35.555ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
118472026-10-29T02:50:35.555ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e7fe9c8-1284-41f4-b091-85735f71e797", "content-length": "147", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118482026-10-29T02:50:35.555ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
118492026-10-29T02:50:35.556ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc574161-f315-41f9-a6ce-60232d23384b", "content-length": "109", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118502026-10-29T02:50:35.556ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
118512026-10-29T02:50:35.556ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0265c75b-4691-4052-aa2b-67d48205866d", "content-length": "109", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118522026-10-29T02:50:35.556ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
118532026-10-29T02:50:35.557ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d398ee66-336f-4d78-8c7b-b583d311abb3", "content-length": "163", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118542026-10-29T02:50:35.557ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
118552026-10-29T02:50:35.558ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f10df165-5b42-47b8-9538-b541b1e8b984", "content-length": "163", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118562026-10-29T02:50:35.558ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
118572026-10-29T02:50:35.558ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6d0aad9-10db-4437-9cfa-1b087147f93c", "content-length": "166", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118582026-10-29T02:50:35.558ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
118592026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "95007589-1a80-4b63-9867-4725b692756c", "content-length": "166", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118602026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
118612026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a306ce28-e5a6-4f7d-ba1e-2386448df350", "content-length": "702", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118622026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
118632026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d951281-e6a4-4049-a895-2ab29f2e7e10", "content-length": "727", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118642026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
118652026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "504eea2c-9971-46d2-85a9-43746f76d2de", "content-length": "729", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118662026-10-29T02:50:35.559ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
118672026-10-29T02:50:35.560ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24e5f1df-93a8-44c6-9e56-bfd82daed89c", "content-length": "728", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118682026-10-29T02:50:35.560ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118692026-10-29T02:50:35.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
118702026-10-29T02:50:35.562ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118712026-10-29T02:50:35.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
118722026-10-29T02:50:35.564ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118732026-10-29T02:50:35.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
118742026-10-29T02:50:35.566ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118752026-10-29T02:50:35.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
118762026-10-29T02:50:35.569ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
118772026-10-29T02:50:35.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
118782026-10-29T02:50:35.569ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
118792026-10-29T02:50:35.569ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 69.663108ms iteration = 38 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
118802026-10-29T02:50:35.572ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
118812026-10-29T02:50:35.573ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
118822026-10-29T02:50:35.664ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "12245a28-4f87-4b28-acd2-baec65efce19", "content-length": "93901", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118832026-10-29T02:50:35.665ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
118842026-10-29T02:50:35.665ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
118852026-10-29T02:50:35.665ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
118862026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
118872026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
118882026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
118892026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
118902026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
118912026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0809054c-5c92-4621-a4c6-7653e7fabafe", "content-length": "64", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118922026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5772071f-558e-46ca-bc4d-58a0adcc8533", "content-length": "64", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118932026-10-29T02:50:35.665ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
118942026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
118952026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c32797f-2eed-4bbc-abf7-eb3f16cfee97", "content-length": "64", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118962026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f0182c0-c644-4487-8d76-70755388ab1c", "content-length": "64", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
118972026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
118982026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
118992026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53d2cf38-616f-4599-8937-0b2176a26377", "content-length": "64", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119002026-10-29T02:50:35.666ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
119012026-10-29T02:50:35.672ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "50893ff4-28e8-48ff-9917-8bb0574a7689", "content-length": "420995", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119022026-10-29T02:50:35.672ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "c056e769-0081-4163-99e1-ef222327c849", "content-length": "421276", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119032026-10-29T02:50:35.672ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8202ec7-aa31-4c51-bde0-876862532005", "content-length": "434085", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119042026-10-29T02:50:35.673ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "75d8ffb9-d20c-4787-8e41-c90da319c63c", "content-length": "424855", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119052026-10-29T02:50:35.673ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffee425b-a515-457a-a953-119462e4a519", "content-length": "421801", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119062026-10-29T02:50:35.676ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
119072026-10-29T02:50:35.676ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
119082026-10-29T02:50:35.676ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
119092026-10-29T02:50:35.676ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
119102026-10-29T02:50:35.676ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
119112026-10-29T02:50:35.676ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
119122026-10-29T02:50:35.676ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
119132026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ab245a-4cb4-45cb-816e-b98e3dbbed45", "content-length": "259", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119142026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
119152026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
119162026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
119172026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
119182026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
119192026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
119202026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
119212026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "836f04b4-a14b-4d84-aa1d-9fa4cc18b6d8", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119222026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d44099c-af06-476b-96ec-b08759a78cfb", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119232026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcb6eb04-80c0-4f2d-a0ae-9555c52b5469", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:50:35 GMT"} })
119242026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
119252026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
119262026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
119272026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
119282026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
119292026-10-29T02:50:35.680ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119302026-10-29T02:50:35.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
119312026-10-29T02:50:35.682ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119322026-10-29T02:50:35.685ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
119332026-10-29T02:50:35.685ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119342026-10-29T02:50:35.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
119352026-10-29T02:50:35.938ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d76d23d2-b342-49a2-a57b-b3d0258cc16c file = nexus/db-queries/src/db/datastore/inventory.rs:2241
119362026-10-29T02:50:35.938ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d76d23d2-b342-49a2-a57b-b3d0258cc16c time_started = 2026-10-29 02:50:35.539596 UTC
119372026-10-29T02:50:35.938ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 65 reason = Dependency
119382026-10-29T02:50:35.938ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
119392026-10-29T02:50:35.938ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 438.514624ms iteration = 15 status = {"collection_id":"d76d23d2-b342-49a2-a57b-b3d0258cc16c","time_done":"2026-10-29 02:50:35.680935 UTC","time_started":"2026-10-29 02:50:35.539596 UTC"}
119402026-10-29T02:50:35.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
119412026-10-29T02:50:35.940ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119422026-10-29T02:50:35.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
119432026-10-29T02:50:35.944ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
119442026-10-29T02:50:35.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
119452026-10-29T02:50:36.004ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
119462026-10-29T02:50:36.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
119472026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 124.924927ms iteration = 65 status = {"Loaded":{"collection_id":"6cd12faf-728b-4184-a999-7aceff377023","time_loaded":"2026-10-29T02:50:35.938586389Z","time_started":"2026-10-29T02:50:35.568482Z"}}
119482026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 45 reason = Dependency
119492026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 33 reason = Dependency
119502026-10-29T02:50:36.063ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
119512026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 24 reason = Dependency
119522026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 13.711\u{b5}s iteration = 33 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
119532026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119542026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 35 reason = Dependency
119552026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119562026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 31 reason = Dependency
119572026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
119582026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
119592026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119602026-10-29T02:50:36.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119612026-10-29T02:50:36.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
119622026-10-29T02:50:36.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
119632026-10-29T02:50:36.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119642026-10-29T02:50:36.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119652026-10-29T02:50:36.066ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119662026-10-29T02:50:36.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119672026-10-29T02:50:36.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
119682026-10-29T02:50:36.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
119692026-10-29T02:50:36.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119702026-10-29T02:50:36.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119712026-10-29T02:50:36.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
119722026-10-29T02:50:36.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119732026-10-29T02:50:36.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119742026-10-29T02:50:36.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
119752026-10-29T02:50:36.072ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
119762026-10-29T02:50:36.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
119772026-10-29T02:50:36.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119782026-10-29T02:50:36.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
119792026-10-29T02:50:36.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119802026-10-29T02:50:36.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119812026-10-29T02:50:36.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119822026-10-29T02:50:36.074ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119832026-10-29T02:50:36.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119842026-10-29T02:50:36.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
119852026-10-29T02:50:36.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
119862026-10-29T02:50:36.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
119872026-10-29T02:50:36.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119882026-10-29T02:50:36.077ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119892026-10-29T02:50:36.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119902026-10-29T02:50:36.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
119912026-10-29T02:50:36.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119922026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
119932026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
119942026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
119952026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
119962026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
119972026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
119982026-10-29T02:50:36.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
119992026-10-29T02:50:36.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120002026-10-29T02:50:36.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120012026-10-29T02:50:36.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120022026-10-29T02:50:36.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
120032026-10-29T02:50:36.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120042026-10-29T02:50:36.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120052026-10-29T02:50:36.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120062026-10-29T02:50:36.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120072026-10-29T02:50:36.084ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120082026-10-29T02:50:36.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120092026-10-29T02:50:36.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120102026-10-29T02:50:36.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120112026-10-29T02:50:36.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120122026-10-29T02:50:36.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
120132026-10-29T02:50:36.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120142026-10-29T02:50:36.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120152026-10-29T02:50:36.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120162026-10-29T02:50:36.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120172026-10-29T02:50:36.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120182026-10-29T02:50:36.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120192026-10-29T02:50:36.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120202026-10-29T02:50:36.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120212026-10-29T02:50:36.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120222026-10-29T02:50:36.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120232026-10-29T02:50:36.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120242026-10-29T02:50:36.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120252026-10-29T02:50:36.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120262026-10-29T02:50:36.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120272026-10-29T02:50:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120282026-10-29T02:50:36.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120292026-10-29T02:50:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120302026-10-29T02:50:36.113ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120312026-10-29T02:50:36.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120322026-10-29T02:50:36.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120332026-10-29T02:50:36.116ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
120342026-10-29T02:50:36.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120352026-10-29T02:50:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120362026-10-29T02:50:36.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120372026-10-29T02:50:36.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120382026-10-29T02:50:36.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120392026-10-29T02:50:36.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120402026-10-29T02:50:36.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120412026-10-29T02:50:36.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120422026-10-29T02:50:36.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120432026-10-29T02:50:36.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120442026-10-29T02:50:36.129ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
120452026-10-29T02:50:36.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120462026-10-29T02:50:36.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120472026-10-29T02:50:36.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120482026-10-29T02:50:36.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120492026-10-29T02:50:36.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120502026-10-29T02:50:36.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120512026-10-29T02:50:36.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120522026-10-29T02:50:36.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
120532026-10-29T02:50:36.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
120542026-10-29T02:50:36.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
120552026-10-29T02:50:36.140ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
120562026-10-29T02:50:36.140ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 23 reason = Dependency
120572026-10-29T02:50:36.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 76.50238ms iteration = 24 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"6cd12faf-728b-4184-a999-7aceff377023","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
120582026-10-29T02:50:36.140ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
120592026-10-29T02:50:36.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
120602026-10-29T02:50:36.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120612026-10-29T02:50:36.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120622026-10-29T02:50:36.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120632026-10-29T02:50:36.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120642026-10-29T02:50:36.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120652026-10-29T02:50:36.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120662026-10-29T02:50:36.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120672026-10-29T02:50:36.147ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120682026-10-29T02:50:36.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120692026-10-29T02:50:36.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
120702026-10-29T02:50:36.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120712026-10-29T02:50:36.149ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
120722026-10-29T02:50:36.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120732026-10-29T02:50:36.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
120742026-10-29T02:50:36.152ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
120752026-10-29T02:50:36.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
120762026-10-29T02:50:36.153ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
120772026-10-29T02:50:36.153ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 89.94237ms iteration = 45 status = {"disks_added":0,"errors":[]}
120782026-10-29T02:50:36.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
120792026-10-29T02:50:36.155ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120802026-10-29T02:50:36.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
120812026-10-29T02:50:36.157ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
120822026-10-29T02:50:36.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
120832026-10-29T02:50:36.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120842026-10-29T02:50:36.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120852026-10-29T02:50:36.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120862026-10-29T02:50:36.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
120872026-10-29T02:50:36.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120882026-10-29T02:50:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120892026-10-29T02:50:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120902026-10-29T02:50:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120912026-10-29T02:50:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120922026-10-29T02:50:36.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
120932026-10-29T02:50:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120942026-10-29T02:50:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120952026-10-29T02:50:36.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
120962026-10-29T02:50:36.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
120972026-10-29T02:50:36.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120982026-10-29T02:50:36.217ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
120992026-10-29T02:50:36.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121002026-10-29T02:50:36.219ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121012026-10-29T02:50:36.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
121022026-10-29T02:50:36.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121032026-10-29T02:50:36.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121042026-10-29T02:50:36.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
121052026-10-29T02:50:36.222ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121062026-10-29T02:50:36.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121072026-10-29T02:50:36.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121082026-10-29T02:50:36.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121092026-10-29T02:50:36.225ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121102026-10-29T02:50:36.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121112026-10-29T02:50:36.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121122026-10-29T02:50:36.226ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121132026-10-29T02:50:36.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
121142026-10-29T02:50:36.229ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121152026-10-29T02:50:36.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121162026-10-29T02:50:36.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
121172026-10-29T02:50:36.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121182026-10-29T02:50:36.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121192026-10-29T02:50:36.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121202026-10-29T02:50:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121212026-10-29T02:50:36.233ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121222026-10-29T02:50:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121232026-10-29T02:50:36.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121242026-10-29T02:50:36.235ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121252026-10-29T02:50:36.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
121262026-10-29T02:50:36.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121272026-10-29T02:50:36.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121282026-10-29T02:50:36.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
121292026-10-29T02:50:36.238ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121302026-10-29T02:50:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121312026-10-29T02:50:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121322026-10-29T02:50:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121332026-10-29T02:50:36.241ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
121342026-10-29T02:50:36.241ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121352026-10-29T02:50:36.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121362026-10-29T02:50:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121372026-10-29T02:50:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121382026-10-29T02:50:36.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121392026-10-29T02:50:36.242ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121402026-10-29T02:50:36.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
121412026-10-29T02:50:36.246ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
121422026-10-29T02:50:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
121432026-10-29T02:50:36.247ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
121442026-10-29T02:50:36.247ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 106.998154ms iteration = 23 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
121452026-10-29T02:50:36.247ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 36 reason = Dependency
121462026-10-29T02:50:36.247ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
121472026-10-29T02:50:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
121482026-10-29T02:50:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
121492026-10-29T02:50:36.248ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
121502026-10-29T02:50:36.248ZINFOnexus (BackgroundTasks): building sitrep 51d4850d-2c27-4454-98f4-14514f85b307 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 51d4850d-2c27-4454-98f4-14514f85b307 (sitrep)
121512026-10-29T02:50:36.248ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 6cd12faf-728b-4184-a999-7aceff377023 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
121522026-10-29T02:50:36.248ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 185.068587ms iteration = 31 status = {"inv_collection_id":"6cd12faf-728b-4184-a999-7aceff377023","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:50:36.248573672Z","outcome":"Unchanged","start_time":"2026-10-29T02:50:36.248546942Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
121532026-10-29T02:50:36.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121542026-10-29T02:50:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121552026-10-29T02:50:36.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121562026-10-29T02:50:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121572026-10-29T02:50:36.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121582026-10-29T02:50:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
121592026-10-29T02:50:36.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121602026-10-29T02:50:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121612026-10-29T02:50:36.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121622026-10-29T02:50:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121632026-10-29T02:50:36.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121642026-10-29T02:50:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
121652026-10-29T02:50:36.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121662026-10-29T02:50:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121672026-10-29T02:50:36.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121682026-10-29T02:50:36.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121692026-10-29T02:50:36.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121702026-10-29T02:50:36.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
121712026-10-29T02:50:36.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121722026-10-29T02:50:36.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121732026-10-29T02:50:36.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121742026-10-29T02:50:36.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121752026-10-29T02:50:36.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121762026-10-29T02:50:36.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
121772026-10-29T02:50:36.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121782026-10-29T02:50:36.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121792026-10-29T02:50:36.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121802026-10-29T02:50:36.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121812026-10-29T02:50:36.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121822026-10-29T02:50:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
121832026-10-29T02:50:36.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121842026-10-29T02:50:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121852026-10-29T02:50:36.301ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
121862026-10-29T02:50:36.301ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 54.687337ms iteration = 36 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
121872026-10-29T02:50:36.342ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
121882026-10-29T02:50:36.342ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
121892026-10-29T02:50:36.342ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = aa46becd-2805-4b72-8a7c-7436de5c5774 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
121902026-10-29T02:50:36.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121912026-10-29T02:50:36.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121922026-10-29T02:50:36.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121932026-10-29T02:50:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
121942026-10-29T02:50:36.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
121952026-10-29T02:50:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
121962026-10-29T02:50:36.351ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 2 limit = 5000 usage_percent = 0
121972026-10-29T02:50:36.351ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
121982026-10-29T02:50:36.352ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 288.500376ms iteration = 35 status = {"Unchanged":{"blueprint_count":2,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
121992026-10-29T02:50:37.493ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = instance_watcher operation_id = vmm_get_state result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/8a67a987-f063-4393-afb4-2e2a36429463/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b222d49-59c6-4b4b-acd9-20e91340d020", "content-length": "131", "date": "Thu, 29 Oct 2026 02:50:37 GMT"} })
122002026-10-29T02:50:37.496ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 07bebe8c-bc27-433b-9fb5-ed2837ae2fd0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 sled_serial = sock state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-10-29T02:50:29.039872139Z }, migration_in: None, migration_out: None } vmm_id = 8a67a987-f063-4393-afb4-2e2a36429463
122012026-10-29T02:50:37.496ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2928 instance_id = 07bebe8c-bc27-433b-9fb5-ed2837ae2fd0 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8a67a987-f063-4393-afb4-2e2a36429463 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 sled_serial = sock vmm_id = 8a67a987-f063-4393-afb4-2e2a36429463 vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-10-29T02:50:29.039872139Z }
122022026-10-29T02:50:37.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 07bebe8c-bc27-433b-9fb5-ed2837ae2fd0 roles = RoleSet { roles: {} } sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 sled_serial = sock vmm_id = 8a67a987-f063-4393-afb4-2e2a36429463
122032026-10-29T02:50:37.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher instance_id = 07bebe8c-bc27-433b-9fb5-ed2837ae2fd0 resource = Database result = Ok(()) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 sled_serial = sock vmm_id = 8a67a987-f063-4393-afb4-2e2a36429463
122042026-10-29T02:50:37.539ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
122052026-10-29T02:50:37.539ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 3.812815058s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
122062026-10-29T02:50:38.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 146 reason = Timeout
122072026-10-29T02:50:38.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122082026-10-29T02:50:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
122092026-10-29T02:50:38.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122102026-10-29T02:50:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
122112026-10-29T02:50:38.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122122026-10-29T02:50:38.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
122132026-10-29T02:50:38.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
122142026-10-29T02:50:38.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.987658ms iteration = 146 status = {"config_updated":false}
122152026-10-29T02:50:40.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 191 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 4d84f7a9-f679-47e9-9192-1f98fa2af557 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
122162026-10-29T02:50:43.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 147 reason = Timeout
122172026-10-29T02:50:43.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
122182026-10-29T02:50:43.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122192026-10-29T02:50:43.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122202026-10-29T02:50:43.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
122212026-10-29T02:50:43.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122222026-10-29T02:50:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122232026-10-29T02:50:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
122242026-10-29T02:50:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
122252026-10-29T02:50:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122262026-10-29T02:50:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122272026-10-29T02:50:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
122282026-10-29T02:50:43.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122292026-10-29T02:50:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122302026-10-29T02:50:43.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122312026-10-29T02:50:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
122322026-10-29T02:50:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
122332026-10-29T02:50:43.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
122342026-10-29T02:50:43.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.745323ms iteration = 147 status = {"config_updated":false}
122352026-10-29T02:50:43.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122362026-10-29T02:50:43.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
122372026-10-29T02:50:43.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122382026-10-29T02:50:43.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
122392026-10-29T02:50:43.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122402026-10-29T02:50:43.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
122412026-10-29T02:50:43.766ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
122422026-10-29T02:50:43.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.233566ms iteration = 74 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
122432026-10-29T02:50:43.779ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122442026-10-29T02:50:43.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122452026-10-29T02:50:43.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.961576ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122462026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 148 reason = Timeout
122472026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122482026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 66 reason = Timeout
122492026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 50 reason = Timeout
122502026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
122512026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
122522026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 52 reason = Timeout
122532026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
122542026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
122552026-10-29T02:50:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
122562026-10-29T02:50:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
122572026-10-29T02:50:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
122582026-10-29T02:50:48.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122592026-10-29T02:50:48.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122602026-10-29T02:50:48.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122612026-10-29T02:50:48.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122622026-10-29T02:50:48.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
122632026-10-29T02:50:48.732ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
122642026-10-29T02:50:48.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
122652026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
122662026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
122672026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
122682026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
122692026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
122702026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
122712026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
122722026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122732026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
122742026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
122752026-10-29T02:50:48.734ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 8.404805ms iteration = 52 status = {"Loaded":{"time_loaded":"2026-10-29T02:50:48.726596477Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
122762026-10-29T02:50:48.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6cd12faf-728b-4184-a999-7aceff377023 original_time_started = 2026-10-29 02:50:35.568482 UTC
122772026-10-29T02:50:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 9.536529ms iteration = 66 status = {"Loaded":{"collection_id":"6cd12faf-728b-4184-a999-7aceff377023","time_loaded":"2026-10-29T02:50:48.726555766Z","time_started":"2026-10-29T02:50:35.568482Z"}}
122782026-10-29T02:50:48.736ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
122792026-10-29T02:50:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.004408ms iteration = 50 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
122802026-10-29T02:50:48.737ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
122812026-10-29T02:50:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.865386ms iteration = 148 status = {"config_updated":false}
122822026-10-29T02:50:49.187ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:1057 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:52227
122832026-10-29T02:50:49.187ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 9a9efdeb-cffd-41f2-becd-456e5974c5ba uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
122842026-10-29T02:50:49.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 9a9efdeb-cffd-41f2-becd-456e5974c5ba roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
122852026-10-29T02:50:49.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 9a9efdeb-cffd-41f2-becd-456e5974c5ba resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
122862026-10-29T02:50:49.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 9a9efdeb-cffd-41f2-becd-456e5974c5ba response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
122872026-10-29T02:50:49.191ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 98497583-72ff-4872-93c5-6ae7dc4b8c3c uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
122882026-10-29T02:50:49.191ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 98497583-72ff-4872-93c5-6ae7dc4b8c3c roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
122892026-10-29T02:50:49.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 98497583-72ff-4872-93c5-6ae7dc4b8c3c resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
122902026-10-29T02:50:49.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 98497583-72ff-4872-93c5-6ae7dc4b8c3c response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
122912026-10-29T02:50:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 165 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = d8a699b4-8721-4a66-a73d-066a55a2c6d7 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
122922026-10-29T02:50:53.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 149 reason = Timeout
122932026-10-29T02:50:53.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
122942026-10-29T02:50:53.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
122952026-10-29T02:50:53.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
122962026-10-29T02:50:53.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122972026-10-29T02:50:53.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122982026-10-29T02:50:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122992026-10-29T02:50:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
123002026-10-29T02:50:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
123012026-10-29T02:50:53.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123022026-10-29T02:50:53.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123032026-10-29T02:50:53.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123042026-10-29T02:50:53.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123052026-10-29T02:50:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
123062026-10-29T02:50:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
123072026-10-29T02:50:53.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
123082026-10-29T02:50:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
123092026-10-29T02:50:53.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123102026-10-29T02:50:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
123112026-10-29T02:50:53.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
123122026-10-29T02:50:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.258673ms iteration = 149 status = {"config_updated":false}
123132026-10-29T02:50:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123142026-10-29T02:50:53.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
123152026-10-29T02:50:53.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123162026-10-29T02:50:53.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
123172026-10-29T02:50:53.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
123182026-10-29T02:50:53.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.406501ms iteration = 75 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
123192026-10-29T02:50:53.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123202026-10-29T02:50:53.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123212026-10-29T02:50:53.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.834903ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123222026-10-29T02:50:58.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 150 reason = Timeout
123232026-10-29T02:50:58.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
123242026-10-29T02:50:58.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
123252026-10-29T02:50:58.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123262026-10-29T02:50:58.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
123272026-10-29T02:50:58.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
123282026-10-29T02:50:58.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
123292026-10-29T02:50:58.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
123302026-10-29T02:50:58.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.393435ms iteration = 150 status = {"config_updated":false}
123312026-10-29T02:51:00.622ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 187 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 7cfa624f-5905-4cbd-a0b1-9528f332bf34 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
123322026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 151 reason = Timeout
123332026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
123342026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
123352026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
123362026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 39 reason = Timeout
123372026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123382026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
123392026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123402026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 26 reason = Timeout
123412026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
123422026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 51 reason = Timeout
123432026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 39 reason = Timeout
123442026-10-29T02:51:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
123452026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123462026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
123472026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123482026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
123492026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
123502026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123512026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
123522026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
123532026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 53 reason = Timeout
123542026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
123552026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
123562026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123572026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
123582026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123592026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 67 reason = Timeout
123602026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
123612026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
123622026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123632026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 46 reason = Timeout
123642026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123652026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
123662026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
123672026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 26 reason = Timeout
123682026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
123692026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
123702026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
123712026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
123722026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
123732026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123742026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123752026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
123762026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123772026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
123782026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
123792026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
123802026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123812026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
123822026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123832026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123842026-10-29T02:51:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 405336981 } })
123852026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
123862026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123872026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
123882026-10-29T02:51:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 405350261 } })
123892026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
123902026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
123912026-10-29T02:51:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 405364681 } })
123922026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123932026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
123942026-10-29T02:51:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
123952026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
123962026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
123972026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6947b6aa-a0e9-489e-bb6c-495bbf2257d0", "content-length": "50", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
123982026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb92eb22-c3af-4352-8168-66fcae918a5b", "content-length": "50", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
123992026-10-29T02:51:03.727ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
124002026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124012026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
124022026-10-29T02:51:03.727ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.621164ms iteration = 26 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
124032026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
124042026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "3acaec9d-e380-495f-ba89-3586f2063ba4", "content-length": "681", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
124052026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
124062026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
124072026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
124082026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
124092026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
124102026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124112026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
124122026-10-29T02:51:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
124132026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124142026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124152026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124162026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124172026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124182026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124192026-10-29T02:51:03.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124202026-10-29T02:51:03.729ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 408264621 } })
124212026-10-29T02:51:03.730ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
124222026-10-29T02:51:03.730ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.288229ms iteration = 26 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
124232026-10-29T02:51:03.730ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
124242026-10-29T02:51:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
124252026-10-29T02:51:03.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
124262026-10-29T02:51:03.731ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.522105ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
124272026-10-29T02:51:03.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124282026-10-29T02:51:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
124292026-10-29T02:51:03.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124302026-10-29T02:51:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
124312026-10-29T02:51:03.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.625309ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124322026-10-29T02:51:03.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
124332026-10-29T02:51:03.736ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
124342026-10-29T02:51:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
124352026-10-29T02:51:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124362026-10-29T02:51:03.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124372026-10-29T02:51:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124382026-10-29T02:51:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124392026-10-29T02:51:03.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124402026-10-29T02:51:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124412026-10-29T02:51:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124422026-10-29T02:51:03.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124432026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
124442026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
124452026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124462026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
124472026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
124482026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
124492026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
124502026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
124512026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
124522026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124532026-10-29T02:51:03.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124542026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
124552026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
124562026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
124572026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
124582026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
124592026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
124602026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
124612026-10-29T02:51:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
124622026-10-29T02:51:03.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124632026-10-29T02:51:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124642026-10-29T02:51:03.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124652026-10-29T02:51:03.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124662026-10-29T02:51:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124672026-10-29T02:51:03.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124682026-10-29T02:51:03.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
124692026-10-29T02:51:03.742ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
124702026-10-29T02:51:03.742ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 16.566964ms iteration = 151 status = {"config_updated":false}
124712026-10-29T02:51:03.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124722026-10-29T02:51:03.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124732026-10-29T02:51:03.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124742026-10-29T02:51:03.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124752026-10-29T02:51:03.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124762026-10-29T02:51:03.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124772026-10-29T02:51:03.750ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
124782026-10-29T02:51:03.750ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 23.801575ms iteration = 53 status = {"Loaded":{"time_loaded":"2026-10-29T02:51:03.726207734Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
124792026-10-29T02:51:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124802026-10-29T02:51:03.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124812026-10-29T02:51:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124822026-10-29T02:51:03.751ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
124832026-10-29T02:51:03.751ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 25.273146ms iteration = 51 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
124842026-10-29T02:51:03.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124852026-10-29T02:51:03.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124862026-10-29T02:51:03.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124872026-10-29T02:51:03.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
124882026-10-29T02:51:03.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124892026-10-29T02:51:03.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
124902026-10-29T02:51:03.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124912026-10-29T02:51:03.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124922026-10-29T02:51:03.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124932026-10-29T02:51:03.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124942026-10-29T02:51:03.768ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
124952026-10-29T02:51:03.768ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124962026-10-29T02:51:03.770ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "defbccbf-3c88-476e-b551-2add4afdabb5", "content-length": "372", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
124972026-10-29T02:51:03.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124982026-10-29T02:51:03.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124992026-10-29T02:51:03.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125002026-10-29T02:51:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125012026-10-29T02:51:03.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125022026-10-29T02:51:03.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125032026-10-29T02:51:03.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125042026-10-29T02:51:03.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125052026-10-29T02:51:03.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
125062026-10-29T02:51:03.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.525006ms iteration = 76 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
125072026-10-29T02:51:03.828ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
125082026-10-29T02:51:03.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
125092026-10-29T02:51:03.834ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
125102026-10-29T02:51:03.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
125112026-10-29T02:51:03.839ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
125122026-10-29T02:51:03.839ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
125132026-10-29T02:51:03.840ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "23080b85-9dcc-4c07-b195-070c9b9943ce", "content-length": "81", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
125142026-10-29T02:51:03.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 120.689299ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
125152026-10-29T02:51:03.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125162026-10-29T02:51:03.848ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
125172026-10-29T02:51:03.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125182026-10-29T02:51:03.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
125192026-10-29T02:51:03.848ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125202026-10-29T02:51:03.848ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 122.534137ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
125212026-10-29T02:51:03.849ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9349f5ea-5c40-40d3-99dd-c73365b18206", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
125222026-10-29T02:51:03.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125232026-10-29T02:51:03.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125242026-10-29T02:51:03.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.342276ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125252026-10-29T02:51:03.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125262026-10-29T02:51:03.853ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125272026-10-29T02:51:03.853ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
125282026-10-29T02:51:03.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125292026-10-29T02:51:03.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125302026-10-29T02:51:03.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
125312026-10-29T02:51:03.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125322026-10-29T02:51:03.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
125332026-10-29T02:51:03.855ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
125342026-10-29T02:51:03.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
125352026-10-29T02:51:03.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
125362026-10-29T02:51:03.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125372026-10-29T02:51:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
125382026-10-29T02:51:03.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125392026-10-29T02:51:03.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.183548ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125402026-10-29T02:51:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125412026-10-29T02:51:03.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125422026-10-29T02:51:03.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125432026-10-29T02:51:03.862ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125442026-10-29T02:51:03.862ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125452026-10-29T02:51:03.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125462026-10-29T02:51:03.862ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6cd12faf-728b-4184-a999-7aceff377023 original_time_started = 2026-10-29 02:50:35.568482 UTC
125472026-10-29T02:51:03.862ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 136.504297ms iteration = 67 status = {"Loaded":{"collection_id":"6cd12faf-728b-4184-a999-7aceff377023","time_loaded":"2026-10-29T02:51:03.726256375Z","time_started":"2026-10-29T02:50:35.568482Z"}}
125482026-10-29T02:51:03.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
125492026-10-29T02:51:03.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125502026-10-29T02:51:03.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 137.830915ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
125512026-10-29T02:51:03.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125522026-10-29T02:51:03.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125532026-10-29T02:51:03.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125542026-10-29T02:51:03.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.632293ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
125552026-10-29T02:51:03.871ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
125562026-10-29T02:51:03.872ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125572026-10-29T02:51:03.872ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "66e1eca1-fbd3-47a5-ac38-2b16f4798801", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
125582026-10-29T02:51:03.872ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 146.424643ms iteration = 39 status = {}
125592026-10-29T02:51:03.879ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
125602026-10-29T02:51:03.879ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
125612026-10-29T02:51:03.880ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "b354ba85-94cc-4bb1-b300-45219b33b724", "content-length": "81", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
125622026-10-29T02:51:03.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
125632026-10-29T02:51:03.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
125642026-10-29T02:51:03.891ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125652026-10-29T02:51:03.892ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
125662026-10-29T02:51:03.892ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
125672026-10-29T02:51:03.893ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0483c30-71b8-4bf8-a488-8b034fb62c56", "content-length": "81", "date": "Thu, 29 Oct 2026 02:51:03 GMT"} })
125682026-10-29T02:51:03.893ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
125692026-10-29T02:51:03.893ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 167.759026ms iteration = 26 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
125702026-10-29T02:51:03.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
125712026-10-29T02:51:03.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
125722026-10-29T02:51:03.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
125732026-10-29T02:51:03.947ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125742026-10-29T02:51:03.947ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
125752026-10-29T02:51:03.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 220.778919ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
125762026-10-29T02:51:03.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125772026-10-29T02:51:03.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125782026-10-29T02:51:03.972ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
125792026-10-29T02:51:03.972ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 246.732298ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
125802026-10-29T02:51:03.974ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
125812026-10-29T02:51:03.974ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 248.316651ms iteration = 39 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
125822026-10-29T02:51:03.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125832026-10-29T02:51:03.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125842026-10-29T02:51:03.988ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
125852026-10-29T02:51:03.989ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 262.822153ms iteration = 26 status = {"incomplete_bootstore_configs":[]}
125862026-10-29T02:51:04.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125872026-10-29T02:51:04.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
125882026-10-29T02:51:04.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125892026-10-29T02:51:04.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
125902026-10-29T02:51:04.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125912026-10-29T02:51:04.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125922026-10-29T02:51:04.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125932026-10-29T02:51:04.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
125942026-10-29T02:51:04.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125952026-10-29T02:51:04.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125962026-10-29T02:51:04.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125972026-10-29T02:51:04.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
125982026-10-29T02:51:04.045ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
125992026-10-29T02:51:04.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "744a651c-77ab-477a-a027-a6972f44971f", "content-length": "691", "date": "Thu, 29 Oct 2026 02:51:04 GMT"} })
126002026-10-29T02:51:04.046ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
126012026-10-29T02:51:04.046ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
126022026-10-29T02:51:04.046ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
126032026-10-29T02:51:04.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.969117ms iteration = 26 status = {}
126042026-10-29T02:51:04.055ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 329.55393ms iteration = 46 status = {"disks_added":0,"errors":[]}
126052026-10-29T02:51:08.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 152 reason = Timeout
126062026-10-29T02:51:08.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126072026-10-29T02:51:08.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126082026-10-29T02:51:08.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126092026-10-29T02:51:08.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
126102026-10-29T02:51:08.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126112026-10-29T02:51:08.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126122026-10-29T02:51:08.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
126132026-10-29T02:51:08.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.564938ms iteration = 152 status = {"config_updated":false}
126142026-10-29T02:51:10.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 170 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 91829693-345a-478a-96cb-e01ad5c77232 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
126152026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 153 reason = Timeout
126162026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126172026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
126182026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
126192026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126202026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126212026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126222026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126232026-10-29T02:51:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
126242026-10-29T02:51:13.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126252026-10-29T02:51:13.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126262026-10-29T02:51:13.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126272026-10-29T02:51:13.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126282026-10-29T02:51:13.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.470783ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126292026-10-29T02:51:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
126302026-10-29T02:51:13.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126312026-10-29T02:51:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126322026-10-29T02:51:13.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126332026-10-29T02:51:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126342026-10-29T02:51:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
126352026-10-29T02:51:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126362026-10-29T02:51:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
126372026-10-29T02:51:13.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
126382026-10-29T02:51:13.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.62202ms iteration = 153 status = {"config_updated":false}
126392026-10-29T02:51:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126402026-10-29T02:51:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
126412026-10-29T02:51:13.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126422026-10-29T02:51:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
126432026-10-29T02:51:13.753ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
126442026-10-29T02:51:13.753ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.545202ms iteration = 77 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
126452026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 154 reason = Timeout
126462026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126472026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 52 reason = Timeout
126482026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
126492026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 54 reason = Timeout
126502026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 68 reason = Timeout
126512026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
126522026-10-29T02:51:18.725ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
126532026-10-29T02:51:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126542026-10-29T02:51:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
126552026-10-29T02:51:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
126562026-10-29T02:51:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
126572026-10-29T02:51:18.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126582026-10-29T02:51:18.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126592026-10-29T02:51:18.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126602026-10-29T02:51:18.728ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126612026-10-29T02:51:18.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
126622026-10-29T02:51:18.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
126632026-10-29T02:51:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
126642026-10-29T02:51:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
126652026-10-29T02:51:18.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126662026-10-29T02:51:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126672026-10-29T02:51:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
126682026-10-29T02:51:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
126692026-10-29T02:51:18.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
126702026-10-29T02:51:18.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
126712026-10-29T02:51:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
126722026-10-29T02:51:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
126732026-10-29T02:51:18.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
126742026-10-29T02:51:18.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
126752026-10-29T02:51:18.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 10.036509ms iteration = 54 status = {"Loaded":{"time_loaded":"2026-10-29T02:51:18.725776918Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
126762026-10-29T02:51:18.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.12234ms iteration = 154 status = {"config_updated":false}
126772026-10-29T02:51:18.736ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
126782026-10-29T02:51:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.717013ms iteration = 52 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
126792026-10-29T02:51:18.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6cd12faf-728b-4184-a999-7aceff377023 original_time_started = 2026-10-29 02:50:35.568482 UTC
126802026-10-29T02:51:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 11.020599ms iteration = 68 status = {"Loaded":{"collection_id":"6cd12faf-728b-4184-a999-7aceff377023","time_loaded":"2026-10-29T02:51:18.725798888Z","time_started":"2026-10-29T02:50:35.568482Z"}}
126812026-10-29T02:51:19.186ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 00241be0-33e2-4b35-91a5-1b636b8e32c6 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
126822026-10-29T02:51:19.186ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 00241be0-33e2-4b35-91a5-1b636b8e32c6 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
126832026-10-29T02:51:19.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 00241be0-33e2-4b35-91a5-1b636b8e32c6 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
126842026-10-29T02:51:19.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 4162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 00241be0-33e2-4b35-91a5-1b636b8e32c6 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
126852026-10-29T02:51:19.191ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 4080331a-54f3-4fdf-8c98-6ece64ea3ea2 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
126862026-10-29T02:51:19.191ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 4080331a-54f3-4fdf-8c98-6ece64ea3ea2 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
126872026-10-29T02:51:19.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 4080331a-54f3-4fdf-8c98-6ece64ea3ea2 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
126882026-10-29T02:51:19.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 3352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 4080331a-54f3-4fdf-8c98-6ece64ea3ea2 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
126892026-10-29T02:51:20.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 190 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 092f33bd-4e8c-47ae-b02c-f51e8cb11a81 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
126902026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 155 reason = Timeout
126912026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
126922026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
126932026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126942026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
126952026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126962026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126972026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
126982026-10-29T02:51:23.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
126992026-10-29T02:51:23.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127002026-10-29T02:51:23.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127012026-10-29T02:51:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127022026-10-29T02:51:23.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127032026-10-29T02:51:23.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.137926ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127042026-10-29T02:51:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127052026-10-29T02:51:23.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127062026-10-29T02:51:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
127072026-10-29T02:51:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
127082026-10-29T02:51:23.733ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
127092026-10-29T02:51:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
127102026-10-29T02:51:23.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127112026-10-29T02:51:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
127122026-10-29T02:51:23.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
127132026-10-29T02:51:23.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.547949ms iteration = 155 status = {"config_updated":false}
127142026-10-29T02:51:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127152026-10-29T02:51:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
127162026-10-29T02:51:23.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127172026-10-29T02:51:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
127182026-10-29T02:51:23.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
127192026-10-29T02:51:23.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.074217ms iteration = 78 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
127202026-10-29T02:51:28.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 156 reason = Timeout
127212026-10-29T02:51:28.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
127222026-10-29T02:51:28.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
127232026-10-29T02:51:28.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127242026-10-29T02:51:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
127252026-10-29T02:51:28.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
127262026-10-29T02:51:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
127272026-10-29T02:51:28.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
127282026-10-29T02:51:28.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.823053ms iteration = 156 status = {"config_updated":false}
127292026-10-29T02:51:30.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 157 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 8ff52511-c284-4fec-8685-70b9dca78810 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
127302026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 157 reason = Timeout
127312026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
127322026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 27 reason = Timeout
127332026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
127342026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
127352026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
127362026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 47 reason = Timeout
127372026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
127382026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
127392026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
127402026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 14 reason = Timeout
127412026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127422026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127432026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
127442026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
127452026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
127462026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
127472026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
127482026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
127492026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
127502026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
127512026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 34 reason = Timeout
127522026-10-29T02:51:33.725ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
127532026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
127542026-10-29T02:51:33.725ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:41:33.725954637 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
127552026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 10.6\u{b5}s iteration = 34 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
127562026-10-29T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
127572026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
127582026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 69 reason = Timeout
127592026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
127602026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
127612026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
127622026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
127632026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
127642026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127652026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
127662026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127672026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
127682026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
127692026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
127702026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 37 reason = Timeout
127712026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 55 reason = Timeout
127722026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
127732026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
127742026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
127752026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
127762026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127772026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
127782026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 36 reason = Timeout
127792026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127802026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
127812026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
127822026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127832026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 14 reason = Timeout
127842026-10-29T02:51:33.726ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
127852026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
127862026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
127872026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 27 reason = Timeout
127882026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127892026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
127902026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
127912026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
127922026-10-29T02:51:33.726ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
127932026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
127942026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 14 reason = Timeout
127952026-10-29T02:51:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
127962026-10-29T02:51:33.726ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = ExternalNetworking step id = Ensure
127972026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
127982026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
127992026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
128002026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
128012026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
128022026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 40 reason = Timeout
128032026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
128042026-10-29T02:51:33.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
128052026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
128062026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128072026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 40 reason = Timeout
128082026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
128092026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
128102026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128112026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
128122026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
128132026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
128142026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128152026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 53 reason = Timeout
128162026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
128172026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
128182026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
128192026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
128202026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
128212026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128222026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
128232026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
128242026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
128252026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128262026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
128272026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
128282026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
128292026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128302026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
128312026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
128322026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
128332026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
128342026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
128352026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
128362026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
128372026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
128382026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
128392026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
128402026-10-29T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
128412026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
128422026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128432026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
128442026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
128452026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
128462026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128472026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128482026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
128492026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128502026-10-29T02:51:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 405607993 } })
128512026-10-29T02:51:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 405617184 } })
128522026-10-29T02:51:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 405618813 } })
128532026-10-29T02:51:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 405632464 } })
128542026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "84ce8034-30c1-40a7-ab06-8441f0398811", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
128552026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
128562026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128572026-10-29T02:51:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 405664914 } })
128582026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3c937cb0-0667-4655-8c7c-eb43d5210a71", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
128592026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
128602026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
128612026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.241006ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
128622026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a5a8dab0-3fb2-4e65-828a-9179b7ae1568", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128632026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128642026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3133ea45-040d-40de-832a-72ab57ffbf56", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128652026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128662026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b1baa2e9-6264-494f-98b3-26f7a78d6dea", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128672026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128682026-10-29T02:51:33.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
128692026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.237946ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
128702026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
128712026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
128722026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.770216ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
128732026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
128742026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
128752026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.41203ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
128762026-10-29T02:51:33.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7c1af82-519d-4155-ba48-88dabb8591bd", "content-length": "50", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} })
128772026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da3f590a-6f17-4abb-8703-90e763e6b3b9", "content-length": "50", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} })
128782026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
128792026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128802026-10-29T02:51:33.728ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
128812026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 2.250087ms iteration = 27 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
128822026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
128832026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fee0ec7-a6d2-4073-8b80-e2759e250e4e", "content-length": "681", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} })
128842026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
128852026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
128862026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
128872026-10-29T02:51:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
128882026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128892026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128902026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
128912026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
128922026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128932026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
128942026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128952026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128962026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128972026-10-29T02:51:33.729ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
128982026-10-29T02:51:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 4.040904ms iteration = 14 status = {"by_rx":{},"error":null}
128992026-10-29T02:51:33.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129002026-10-29T02:51:33.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129012026-10-29T02:51:33.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129022026-10-29T02:51:33.730ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 408701168 } })
129032026-10-29T02:51:33.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129042026-10-29T02:51:33.731ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
129052026-10-29T02:51:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.81778ms iteration = 27 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
129062026-10-29T02:51:33.731ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:41:33.725954637 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
129072026-10-29T02:51:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.437433ms iteration = 14 status = {"expiration":"2026-10-29T02:41:33.725954637Z","pruned":[]}
129082026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
129092026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
129102026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.049466ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
129112026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
129122026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129132026-10-29T02:51:33.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
129142026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129152026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 14 reason = Timeout
129162026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
129172026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
129182026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
129192026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129202026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
129212026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129222026-10-29T02:51:33.732ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129232026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
129242026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129252026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
129262026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.783141ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
129272026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129282026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
129292026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129302026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
129312026-10-29T02:51:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
129322026-10-29T02:51:33.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129332026-10-29T02:51:33.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129342026-10-29T02:51:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.841523ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
129352026-10-29T02:51:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
129362026-10-29T02:51:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129372026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129382026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129392026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129402026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129412026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129422026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
129432026-10-29T02:51:33.734ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
129442026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.980397ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
129452026-10-29T02:51:33.734ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129462026-10-29T02:51:33.736ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
129472026-10-29T02:51:33.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.301064ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129482026-10-29T02:51:33.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129492026-10-29T02:51:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
129502026-10-29T02:51:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
129512026-10-29T02:51:33.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129522026-10-29T02:51:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129532026-10-29T02:51:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
129542026-10-29T02:51:33.740ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
129552026-10-29T02:51:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129562026-10-29T02:51:33.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129572026-10-29T02:51:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129582026-10-29T02:51:33.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129592026-10-29T02:51:33.742ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129602026-10-29T02:51:33.742ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129612026-10-29T02:51:33.742ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129622026-10-29T02:51:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
129632026-10-29T02:51:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
129642026-10-29T02:51:33.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
129652026-10-29T02:51:33.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
129662026-10-29T02:51:33.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
129672026-10-29T02:51:33.744ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
129682026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
129692026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
129702026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
129712026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
129722026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
129732026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
129742026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
129752026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
129762026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129772026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129782026-10-29T02:51:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
129792026-10-29T02:51:33.746ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
129802026-10-29T02:51:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
129812026-10-29T02:51:33.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129822026-10-29T02:51:33.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129832026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
129842026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
129852026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
129862026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
129872026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129882026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129892026-10-29T02:51:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129902026-10-29T02:51:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
129912026-10-29T02:51:33.748ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 22.266993ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
129922026-10-29T02:51:33.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129932026-10-29T02:51:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129942026-10-29T02:51:33.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129952026-10-29T02:51:33.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129962026-10-29T02:51:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
129972026-10-29T02:51:33.749ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
129982026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129992026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
130002026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130012026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
130022026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
130032026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130042026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
130052026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
130062026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
130072026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
130082026-10-29T02:51:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
130092026-10-29T02:51:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
130102026-10-29T02:51:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
130112026-10-29T02:51:33.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
130122026-10-29T02:51:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130132026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
130142026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
130152026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
130162026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
130172026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 27.337499ms iteration = 55 status = {"Loaded":{"time_loaded":"2026-10-29T02:51:33.726123440Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
130182026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130192026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130202026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
130212026-10-29T02:51:33.753ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
130222026-10-29T02:51:33.754ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130232026-10-29T02:51:33.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
130242026-10-29T02:51:33.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
130252026-10-29T02:51:33.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
130262026-10-29T02:51:33.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
130272026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
130282026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
130292026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
130302026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130312026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
130322026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
130332026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130342026-10-29T02:51:33.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
130352026-10-29T02:51:33.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130362026-10-29T02:51:33.773ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
130372026-10-29T02:51:33.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130382026-10-29T02:51:33.773ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 46.869954ms iteration = 157 status = {"config_updated":false}
130392026-10-29T02:51:33.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
130402026-10-29T02:51:33.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130412026-10-29T02:51:33.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130422026-10-29T02:51:33.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130432026-10-29T02:51:33.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130442026-10-29T02:51:33.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
130452026-10-29T02:51:33.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130462026-10-29T02:51:33.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130472026-10-29T02:51:33.784ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 6cd12faf-728b-4184-a999-7aceff377023 original_time_started = 2026-10-29 02:50:35.568482 UTC
130482026-10-29T02:51:33.784ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 58.710691ms iteration = 69 status = {"Loaded":{"collection_id":"6cd12faf-728b-4184-a999-7aceff377023","time_loaded":"2026-10-29T02:51:33.725981848Z","time_started":"2026-10-29T02:50:35.568482Z"}}
130492026-10-29T02:51:33.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130502026-10-29T02:51:33.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130512026-10-29T02:51:33.802ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 70.014635ms iteration = 14 status = {"samples_queued":6}
130522026-10-29T02:51:33.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130532026-10-29T02:51:33.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
130542026-10-29T02:51:33.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130552026-10-29T02:51:33.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
130562026-10-29T02:51:33.821ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
130572026-10-29T02:51:33.821ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 94.930663ms iteration = 53 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
130582026-10-29T02:51:33.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130592026-10-29T02:51:33.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130602026-10-29T02:51:33.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130612026-10-29T02:51:33.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130622026-10-29T02:51:33.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130632026-10-29T02:51:33.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130642026-10-29T02:51:33.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130652026-10-29T02:51:33.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130662026-10-29T02:51:33.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130672026-10-29T02:51:33.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130682026-10-29T02:51:33.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
130692026-10-29T02:51:33.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130702026-10-29T02:51:33.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130712026-10-29T02:51:33.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
130722026-10-29T02:51:33.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 161.726711ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
130732026-10-29T02:51:33.888ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130742026-10-29T02:51:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130752026-10-29T02:51:33.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130762026-10-29T02:51:33.896ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130772026-10-29T02:51:33.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130782026-10-29T02:51:33.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130792026-10-29T02:51:33.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130802026-10-29T02:51:33.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
130812026-10-29T02:51:33.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130822026-10-29T02:51:33.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130832026-10-29T02:51:33.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130842026-10-29T02:51:33.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130852026-10-29T02:51:33.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 176.747474ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
130862026-10-29T02:51:33.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130872026-10-29T02:51:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
130882026-10-29T02:51:33.911ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130892026-10-29T02:51:33.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130902026-10-29T02:51:33.911ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130912026-10-29T02:51:33.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.096717ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130922026-10-29T02:51:33.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130932026-10-29T02:51:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
130942026-10-29T02:51:33.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130952026-10-29T02:51:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130962026-10-29T02:51:33.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130972026-10-29T02:51:33.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130982026-10-29T02:51:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
130992026-10-29T02:51:33.917ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
131002026-10-29T02:51:33.918ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
131012026-10-29T02:51:33.918ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 185.906984ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
131022026-10-29T02:51:33.921ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
131032026-10-29T02:51:33.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 195.707218ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
131042026-10-29T02:51:33.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131052026-10-29T02:51:33.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
131062026-10-29T02:51:33.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
131072026-10-29T02:51:33.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
131082026-10-29T02:51:33.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131092026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
131102026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
131112026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
131122026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131132026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
131142026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
131152026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131162026-10-29T02:51:33.930ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9f7895a-191e-44a0-88c9-87ee12e1f9cd", "content-length": "81", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} })
131172026-10-29T02:51:33.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131182026-10-29T02:51:33.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131192026-10-29T02:51:33.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
131202026-10-29T02:51:33.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131212026-10-29T02:51:33.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
131222026-10-29T02:51:33.937ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
131232026-10-29T02:51:33.937ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
131242026-10-29T02:51:33.938ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d71e29-f0c0-48f0-8781-354fcd012424", "content-length": "81", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} })
131252026-10-29T02:51:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
131262026-10-29T02:51:33.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131272026-10-29T02:51:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
131282026-10-29T02:51:33.941ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
131292026-10-29T02:51:33.941ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 215.212734ms iteration = 14 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
131302026-10-29T02:51:33.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131312026-10-29T02:51:33.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131322026-10-29T02:51:33.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131332026-10-29T02:51:33.946ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
131342026-10-29T02:51:33.946ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
131352026-10-29T02:51:33.947ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f46c037-86ca-4014-9bb1-e866685debb4", "content-length": "81", "date": "Thu, 29 Oct 2026 02:51:33 GMT"} })
131362026-10-29T02:51:33.947ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
131372026-10-29T02:51:33.947ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 221.853651ms iteration = 27 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
131382026-10-29T02:51:33.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
131392026-10-29T02:51:33.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
131402026-10-29T02:51:33.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131412026-10-29T02:51:33.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
131422026-10-29T02:51:33.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
131432026-10-29T02:51:33.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
131442026-10-29T02:51:33.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
131452026-10-29T02:51:33.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
131462026-10-29T02:51:33.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131472026-10-29T02:51:33.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
131482026-10-29T02:51:33.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
131492026-10-29T02:51:33.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
131502026-10-29T02:51:33.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131512026-10-29T02:51:33.988ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
131522026-10-29T02:51:33.992ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
131532026-10-29T02:51:33.992ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 266.157662ms iteration = 40 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
131542026-10-29T02:51:33.993ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
131552026-10-29T02:51:33.997ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
131562026-10-29T02:51:34.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
131572026-10-29T02:51:34.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
131582026-10-29T02:51:34.013ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
131592026-10-29T02:51:34.013ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 286.809032ms iteration = 79 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
131602026-10-29T02:51:34.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131612026-10-29T02:51:34.017ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
131622026-10-29T02:51:34.024ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
131632026-10-29T02:51:34.027ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
131642026-10-29T02:51:34.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 304.679843ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
131652026-10-29T02:51:34.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
131662026-10-29T02:51:34.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
131672026-10-29T02:51:34.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131682026-10-29T02:51:34.036ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
131692026-10-29T02:51:34.036ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
131702026-10-29T02:51:34.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131712026-10-29T02:51:34.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131722026-10-29T02:51:34.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131732026-10-29T02:51:34.040ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
131742026-10-29T02:51:34.043ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
131752026-10-29T02:51:34.046ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
131762026-10-29T02:51:34.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131772026-10-29T02:51:34.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131782026-10-29T02:51:34.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131792026-10-29T02:51:34.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
131802026-10-29T02:51:34.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 324.590556ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131812026-10-29T02:51:34.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
131822026-10-29T02:51:34.051ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
131832026-10-29T02:51:34.051ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
131842026-10-29T02:51:34.051ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
131852026-10-29T02:51:34.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 324.890873ms iteration = 14 status = {"generation":2}
131862026-10-29T02:51:34.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131872026-10-29T02:51:34.059ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
131882026-10-29T02:51:34.061ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
131892026-10-29T02:51:34.062ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 741183268 } })
131902026-10-29T02:51:34.067ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 341.164261ms iteration = 14 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
131912026-10-29T02:51:34.070ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
131922026-10-29T02:51:34.070ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 344.092502ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
131932026-10-29T02:51:34.079ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
131942026-10-29T02:51:34.080ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
131952026-10-29T02:51:34.080ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
131962026-10-29T02:51:34.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131972026-10-29T02:51:34.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131982026-10-29T02:51:34.085ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
131992026-10-29T02:51:34.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132002026-10-29T02:51:34.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 362.173317ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
132012026-10-29T02:51:34.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132022026-10-29T02:51:34.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132032026-10-29T02:51:34.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
132042026-10-29T02:51:34.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
132052026-10-29T02:51:34.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132062026-10-29T02:51:34.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132072026-10-29T02:51:34.103ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
132082026-10-29T02:51:34.103ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
132092026-10-29T02:51:34.103ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
132102026-10-29T02:51:34.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 371.42446ms iteration = 14 status = {"generation":1}
132112026-10-29T02:51:34.105ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
132122026-10-29T02:51:34.108ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
132132026-10-29T02:51:34.112ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
132142026-10-29T02:51:34.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
132152026-10-29T02:51:34.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
132162026-10-29T02:51:34.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132172026-10-29T02:51:34.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132182026-10-29T02:51:34.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132192026-10-29T02:51:34.120ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
132202026-10-29T02:51:34.120ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132212026-10-29T02:51:34.120ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
132222026-10-29T02:51:34.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132232026-10-29T02:51:34.120ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade9b5d6-f6d4-472b-a6f7-09d6f5d9a456", "content-length": "372", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
132242026-10-29T02:51:34.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
132252026-10-29T02:51:34.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132262026-10-29T02:51:34.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132272026-10-29T02:51:34.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132282026-10-29T02:51:34.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132292026-10-29T02:51:34.123ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132302026-10-29T02:51:34.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132312026-10-29T02:51:34.124ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
132322026-10-29T02:51:34.126ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
132332026-10-29T02:51:34.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
132342026-10-29T02:51:34.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
132352026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
132362026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132372026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
132382026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
132392026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
132402026-10-29T02:51:34.129ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
132412026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132422026-10-29T02:51:34.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
132432026-10-29T02:51:34.130ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = SledList step id = Fetch
132442026-10-29T02:51:34.130ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132452026-10-29T02:51:34.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132462026-10-29T02:51:34.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132472026-10-29T02:51:34.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
132482026-10-29T02:51:34.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
132492026-10-29T02:51:34.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
132502026-10-29T02:51:34.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132512026-10-29T02:51:34.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132522026-10-29T02:51:34.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132532026-10-29T02:51:34.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132542026-10-29T02:51:34.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132552026-10-29T02:51:34.137ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 411.940842ms iteration = 47 status = {"disks_added":0,"errors":[]}
132562026-10-29T02:51:34.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132572026-10-29T02:51:34.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
132582026-10-29T02:51:34.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
132592026-10-29T02:51:34.141ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
132602026-10-29T02:51:34.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
132612026-10-29T02:51:34.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
132622026-10-29T02:51:34.141ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e8d180b-9c6f-4c21-bbfe-679ec615fb71", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
132632026-10-29T02:51:34.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132642026-10-29T02:51:34.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132652026-10-29T02:51:34.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
132662026-10-29T02:51:34.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132672026-10-29T02:51:34.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132682026-10-29T02:51:34.145ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
132692026-10-29T02:51:34.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
132702026-10-29T02:51:34.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132712026-10-29T02:51:34.146ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "18be4789-6e3e-4d89-aee0-a9d2325aefeb", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
132722026-10-29T02:51:34.146ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
132732026-10-29T02:51:34.147ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
132742026-10-29T02:51:34.147ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 420.48453ms iteration = 14 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
132752026-10-29T02:51:34.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
132762026-10-29T02:51:34.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132772026-10-29T02:51:34.150ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = DeployNexusRecords step id = Ensure
132782026-10-29T02:51:34.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132792026-10-29T02:51:34.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132802026-10-29T02:51:34.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132812026-10-29T02:51:34.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132822026-10-29T02:51:34.152ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
132832026-10-29T02:51:34.152ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 426.812671ms iteration = 37 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
132842026-10-29T02:51:34.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132852026-10-29T02:51:34.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132862026-10-29T02:51:34.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
132872026-10-29T02:51:34.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
132882026-10-29T02:51:34.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
132892026-10-29T02:51:34.157ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
132902026-10-29T02:51:34.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
132912026-10-29T02:51:34.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
132922026-10-29T02:51:34.158ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
132932026-10-29T02:51:34.158ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132942026-10-29T02:51:34.158ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d1451f01-eaaf-47ba-9c0d-df63fff2c28f", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
132952026-10-29T02:51:34.158ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 432.587111ms iteration = 40 status = {}
132962026-10-29T02:51:34.158ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 41 reason = Dependency
132972026-10-29T02:51:34.158ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132982026-10-29T02:51:34.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132992026-10-29T02:51:34.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133002026-10-29T02:51:34.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133012026-10-29T02:51:34.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133022026-10-29T02:51:34.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133032026-10-29T02:51:34.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133042026-10-29T02:51:34.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133052026-10-29T02:51:34.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133062026-10-29T02:51:34.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133072026-10-29T02:51:34.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
133082026-10-29T02:51:34.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133092026-10-29T02:51:34.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133102026-10-29T02:51:34.171ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
133112026-10-29T02:51:34.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133122026-10-29T02:51:34.171ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "027d9330-47cc-44e0-80eb-409bbefbd735", "content-length": "691", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
133132026-10-29T02:51:34.172ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
133142026-10-29T02:51:34.172ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
133152026-10-29T02:51:34.172ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
133162026-10-29T02:51:34.172ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 439.916293ms iteration = 27 status = {}
133172026-10-29T02:51:34.172ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = SledAgent step id = Ensure
133182026-10-29T02:51:34.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133192026-10-29T02:51:34.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133202026-10-29T02:51:34.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133212026-10-29T02:51:34.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
133222026-10-29T02:51:34.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "a688ab30-ba95-45d0-a7de-d9270ca61445", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
133232026-10-29T02:51:34.177ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = FirewallRules step id = Ensure
133242026-10-29T02:51:34.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133252026-10-29T02:51:34.177ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
133262026-10-29T02:51:34.177ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 451.134817ms iteration = 27 status = {"incomplete_bootstore_configs":[]}
133272026-10-29T02:51:34.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133282026-10-29T02:51:34.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133292026-10-29T02:51:34.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133302026-10-29T02:51:34.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133312026-10-29T02:51:34.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133322026-10-29T02:51:34.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133332026-10-29T02:51:34.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133342026-10-29T02:51:34.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133352026-10-29T02:51:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133362026-10-29T02:51:34.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133372026-10-29T02:51:34.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133382026-10-29T02:51:34.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133392026-10-29T02:51:34.194ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
133402026-10-29T02:51:34.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
133412026-10-29T02:51:34.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
133422026-10-29T02:51:34.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133432026-10-29T02:51:34.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133442026-10-29T02:51:34.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133452026-10-29T02:51:34.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133462026-10-29T02:51:34.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133472026-10-29T02:51:34.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133482026-10-29T02:51:34.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133492026-10-29T02:51:34.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
133502026-10-29T02:51:34.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133512026-10-29T02:51:34.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133522026-10-29T02:51:34.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133532026-10-29T02:51:34.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133542026-10-29T02:51:34.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133552026-10-29T02:51:34.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133562026-10-29T02:51:34.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133572026-10-29T02:51:34.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133582026-10-29T02:51:34.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133592026-10-29T02:51:34.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133602026-10-29T02:51:34.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133612026-10-29T02:51:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133622026-10-29T02:51:34.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133632026-10-29T02:51:34.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133642026-10-29T02:51:34.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
133652026-10-29T02:51:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
133662026-10-29T02:51:34.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133672026-10-29T02:51:34.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133682026-10-29T02:51:34.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
133692026-10-29T02:51:34.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
133702026-10-29T02:51:34.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
133712026-10-29T02:51:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
133722026-10-29T02:51:34.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133732026-10-29T02:51:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133742026-10-29T02:51:34.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
133752026-10-29T02:51:34.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133762026-10-29T02:51:34.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
133772026-10-29T02:51:34.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133782026-10-29T02:51:34.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
133792026-10-29T02:51:34.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133802026-10-29T02:51:34.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133812026-10-29T02:51:34.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
133822026-10-29T02:51:34.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
133832026-10-29T02:51:34.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
133842026-10-29T02:51:34.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133852026-10-29T02:51:34.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
133862026-10-29T02:51:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
133872026-10-29T02:51:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133882026-10-29T02:51:34.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133892026-10-29T02:51:34.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133902026-10-29T02:51:34.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133912026-10-29T02:51:34.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133922026-10-29T02:51:34.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133932026-10-29T02:51:34.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133942026-10-29T02:51:34.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
133952026-10-29T02:51:34.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
133962026-10-29T02:51:34.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
133972026-10-29T02:51:34.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
133982026-10-29T02:51:34.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
133992026-10-29T02:51:34.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134002026-10-29T02:51:34.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134012026-10-29T02:51:34.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134022026-10-29T02:51:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134032026-10-29T02:51:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134042026-10-29T02:51:34.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134052026-10-29T02:51:34.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134062026-10-29T02:51:34.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134072026-10-29T02:51:34.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134082026-10-29T02:51:34.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134092026-10-29T02:51:34.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134102026-10-29T02:51:34.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
134112026-10-29T02:51:34.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134122026-10-29T02:51:34.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134132026-10-29T02:51:34.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134142026-10-29T02:51:34.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134152026-10-29T02:51:34.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
134162026-10-29T02:51:34.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134172026-10-29T02:51:34.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134182026-10-29T02:51:34.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134192026-10-29T02:51:34.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134202026-10-29T02:51:34.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134212026-10-29T02:51:34.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134222026-10-29T02:51:34.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134232026-10-29T02:51:34.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
134242026-10-29T02:51:34.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134252026-10-29T02:51:34.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134262026-10-29T02:51:34.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134272026-10-29T02:51:34.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134282026-10-29T02:51:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134292026-10-29T02:51:34.304ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
134302026-10-29T02:51:34.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134312026-10-29T02:51:34.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134322026-10-29T02:51:34.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134332026-10-29T02:51:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
134342026-10-29T02:51:34.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134352026-10-29T02:51:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134362026-10-29T02:51:34.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134372026-10-29T02:51:34.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134382026-10-29T02:51:34.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134392026-10-29T02:51:34.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134402026-10-29T02:51:34.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134412026-10-29T02:51:34.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134422026-10-29T02:51:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134432026-10-29T02:51:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134442026-10-29T02:51:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134452026-10-29T02:51:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134462026-10-29T02:51:34.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134472026-10-29T02:51:34.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
134482026-10-29T02:51:34.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134492026-10-29T02:51:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134502026-10-29T02:51:34.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134512026-10-29T02:51:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134522026-10-29T02:51:34.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134532026-10-29T02:51:34.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134542026-10-29T02:51:34.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134552026-10-29T02:51:34.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134562026-10-29T02:51:34.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134572026-10-29T02:51:34.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134582026-10-29T02:51:34.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134592026-10-29T02:51:34.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134602026-10-29T02:51:34.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
134612026-10-29T02:51:34.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134622026-10-29T02:51:34.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134632026-10-29T02:51:34.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
134642026-10-29T02:51:34.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134652026-10-29T02:51:34.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134662026-10-29T02:51:34.334ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
134672026-10-29T02:51:34.334ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134682026-10-29T02:51:34.335ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c473b83-2436-4685-8bf1-bbe91bba8edf", "content-length": "372", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
134692026-10-29T02:51:34.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134702026-10-29T02:51:34.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134712026-10-29T02:51:34.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134722026-10-29T02:51:34.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134732026-10-29T02:51:34.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134742026-10-29T02:51:34.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134752026-10-29T02:51:34.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134762026-10-29T02:51:34.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134772026-10-29T02:51:34.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134782026-10-29T02:51:34.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134792026-10-29T02:51:34.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
134802026-10-29T02:51:34.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134812026-10-29T02:51:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134822026-10-29T02:51:34.346ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
134832026-10-29T02:51:34.346ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
134842026-10-29T02:51:34.346ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = d3c7efda-006d-4d31-b49e-e6ead442e5cf parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
134852026-10-29T02:51:34.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134862026-10-29T02:51:34.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134872026-10-29T02:51:34.348ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
134882026-10-29T02:51:34.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
134892026-10-29T02:51:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
134902026-10-29T02:51:34.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134912026-10-29T02:51:34.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
134922026-10-29T02:51:34.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
134932026-10-29T02:51:34.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
134942026-10-29T02:51:34.354ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
134952026-10-29T02:51:34.354ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
134962026-10-29T02:51:34.354ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5737c080-7f93-4daa-9c7c-70551eede655", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
134972026-10-29T02:51:34.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134982026-10-29T02:51:34.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134992026-10-29T02:51:34.356ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
135002026-10-29T02:51:34.356ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
135012026-10-29T02:51:34.356ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
135022026-10-29T02:51:34.357ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 2 limit = 5000 usage_percent = 0
135032026-10-29T02:51:34.357ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
135042026-10-29T02:51:34.357ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 630.934194ms iteration = 36 status = {"Unchanged":{"blueprint_count":2,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
135052026-10-29T02:51:34.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135062026-10-29T02:51:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135072026-10-29T02:51:34.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135082026-10-29T02:51:34.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135092026-10-29T02:51:34.366ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
135102026-10-29T02:51:34.366ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135112026-10-29T02:51:34.366ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "34c88751-4ba4-4c61-a559-691b26a173a9", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
135122026-10-29T02:51:34.366ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 207.87181ms iteration = 41 status = {}
135132026-10-29T02:51:34.465ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
135142026-10-29T02:51:34.465ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
135152026-10-29T02:51:34.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135162026-10-29T02:51:34.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135172026-10-29T02:51:34.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135182026-10-29T02:51:34.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135192026-10-29T02:51:34.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135202026-10-29T02:51:34.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
135212026-10-29T02:51:34.476ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
135222026-10-29T02:51:34.477ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "4e306548-bba6-483c-810b-7163f3496efb", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
135232026-10-29T02:51:34.477ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
135242026-10-29T02:51:34.477ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = Dns step id = Ensure
135252026-10-29T02:51:34.477ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
135262026-10-29T02:51:34.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135272026-10-29T02:51:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135282026-10-29T02:51:34.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135292026-10-29T02:51:34.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135302026-10-29T02:51:34.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135312026-10-29T02:51:34.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135322026-10-29T02:51:34.489ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
135332026-10-29T02:51:34.489ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
135342026-10-29T02:51:34.489ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
135352026-10-29T02:51:34.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135362026-10-29T02:51:34.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135372026-10-29T02:51:34.491ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
135382026-10-29T02:51:34.491ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 765.354478ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
135392026-10-29T02:51:34.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135402026-10-29T02:51:34.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135412026-10-29T02:51:34.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135422026-10-29T02:51:34.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135432026-10-29T02:51:34.499ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
135442026-10-29T02:51:34.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
135452026-10-29T02:51:34.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135462026-10-29T02:51:34.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135472026-10-29T02:51:34.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135482026-10-29T02:51:34.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135492026-10-29T02:51:34.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135502026-10-29T02:51:34.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135512026-10-29T02:51:34.508ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
135522026-10-29T02:51:34.508ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
135532026-10-29T02:51:34.508ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
135542026-10-29T02:51:34.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135552026-10-29T02:51:34.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135562026-10-29T02:51:34.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135572026-10-29T02:51:34.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135582026-10-29T02:51:34.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135592026-10-29T02:51:34.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135602026-10-29T02:51:34.516ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
135612026-10-29T02:51:34.516ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
135622026-10-29T02:51:34.516ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
135632026-10-29T02:51:34.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135642026-10-29T02:51:34.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135652026-10-29T02:51:34.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135662026-10-29T02:51:34.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135672026-10-29T02:51:34.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135682026-10-29T02:51:34.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135692026-10-29T02:51:34.525ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
135702026-10-29T02:51:34.525ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
135712026-10-29T02:51:34.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135722026-10-29T02:51:34.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135732026-10-29T02:51:34.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135742026-10-29T02:51:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135752026-10-29T02:51:34.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135762026-10-29T02:51:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135772026-10-29T02:51:34.532ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
135782026-10-29T02:51:34.532ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
135792026-10-29T02:51:34.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135802026-10-29T02:51:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135812026-10-29T02:51:34.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135822026-10-29T02:51:34.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
135832026-10-29T02:51:34.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135842026-10-29T02:51:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135852026-10-29T02:51:34.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135862026-10-29T02:51:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135872026-10-29T02:51:34.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
135882026-10-29T02:51:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
135892026-10-29T02:51:34.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135902026-10-29T02:51:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
135912026-10-29T02:51:34.547ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
135922026-10-29T02:51:34.547ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
135932026-10-29T02:51:34.547ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = OmicronZones step id = Cleanup
135942026-10-29T02:51:34.547ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = OmicronZones step id = Cleanup
135952026-10-29T02:51:34.547ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = PhysicalDisks step id = Cleanup
135962026-10-29T02:51:34.548ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = Clickhouse step id = Ensure
135972026-10-29T02:51:34.548ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = Clickhouse step id = Ensure
135982026-10-29T02:51:34.548ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
135992026-10-29T02:51:34.551ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "b37a9edf-5785-4523-a2f3-39167316e279", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136002026-10-29T02:51:34.551ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = SupportBundles step id = Cleanup
136012026-10-29T02:51:34.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136022026-10-29T02:51:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136032026-10-29T02:51:34.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136042026-10-29T02:51:34.555ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
136052026-10-29T02:51:34.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136062026-10-29T02:51:34.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136072026-10-29T02:51:34.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136082026-10-29T02:51:34.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136092026-10-29T02:51:34.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136102026-10-29T02:51:34.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
136112026-10-29T02:51:34.622ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = OmicronZones step id = Cleanup
136122026-10-29T02:51:34.622ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
136132026-10-29T02:51:34.622ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
136142026-10-29T02:51:34.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136152026-10-29T02:51:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136162026-10-29T02:51:34.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136172026-10-29T02:51:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
136182026-10-29T02:51:34.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136192026-10-29T02:51:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136202026-10-29T02:51:34.628ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
136212026-10-29T02:51:34.628ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
136222026-10-29T02:51:34.628ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = OmicronZones step id = Cleanup
136232026-10-29T02:51:34.628ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
136242026-10-29T02:51:34.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136252026-10-29T02:51:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136262026-10-29T02:51:34.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136272026-10-29T02:51:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
136282026-10-29T02:51:34.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136292026-10-29T02:51:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136302026-10-29T02:51:34.681ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
136312026-10-29T02:51:34.681ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = Cockroach step id = Ensure
136322026-10-29T02:51:34.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
136332026-10-29T02:51:34.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
136342026-10-29T02:51:34.690ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
136352026-10-29T02:51:34.690ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = 6d17245d-1e1a-402a-aeea-7ba6142bf474 step component = MgsUpdates step id = Ensure
136362026-10-29T02:51:34.690ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 41 reason = Dependency
136372026-10-29T02:51:34.690ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 16 reason = Dependency
136382026-10-29T02:51:34.690ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136392026-10-29T02:51:34.690ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
136402026-10-29T02:51:34.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 964.699441ms iteration = 15 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":2789,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":403763202,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":403763162,"secs":0}},"event_index":1,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":403776592,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":20468556,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":20468506,"secs":0}},"event_index":2,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":424257948,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":22212592,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":22212532,"secs":0}},"event_index":3,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":446493430,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4434282,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":4434242,"secs":0}},"event_index":4,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":450945673,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":300713020,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":300712960,"secs":0}},"event_index":5,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":751670543,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":70008975,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":70008925,"secs":0}},"event_index":6,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":821691628,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":5390,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":5350,"secs":0}},"event_index":7,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":821709509,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2010,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":1970,"secs":0}},"event_index":8,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":821713549,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2880,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":2850,"secs":0}},"event_index":9,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":821717959,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2060,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":2020,"secs":0}},"event_index":10,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":821721399,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3631046,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":3631006,"secs":0}},"event_index":11,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":825354115,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":70935264,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":70935214,"secs":0}},"event_index":12,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":896298239,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":5440084,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":5440044,"secs":0}},"event_index":13,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":901756283,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":53628724,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":53628684,"secs":0}},"event_index":14,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":955393417,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":8867014,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":8866964,"secs":0}},"event_index":15,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":964276352,"secs":0}},{"data":{"attempt_elapsed":{"nanos":5690,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":5650,"secs":0}},"event_index":16,"execution_id":"6d17245d-1e1a-402a-aeea-7ba6142bf474","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":964289702,"secs":0}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
136412026-10-29T02:51:34.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
136422026-10-29T02:51:34.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136432026-10-29T02:51:34.693ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136442026-10-29T02:51:34.693ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136452026-10-29T02:51:34.696ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
136462026-10-29T02:51:34.696ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136472026-10-29T02:51:34.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136482026-10-29T02:51:34.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
136492026-10-29T02:51:34.696ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
136502026-10-29T02:51:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
136512026-10-29T02:51:34.699ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
136522026-10-29T02:51:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
136532026-10-29T02:51:34.700ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(cd4ebd71-78bc-4c03-9587-d5b137def4e0, 0), (63f32cdd-9518-4a2a-949d-5cfd979654cb, 0), (9a3e2159-904d-4a43-ad6f-208498b145f0, 0), (d76d23d2-b342-49a2-a57b-b3d0258cc16c, 0)] collection_id = cd4ebd71-78bc-4c03-9587-d5b137def4e0
136542026-10-29T02:51:34.700ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136552026-10-29T02:51:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136562026-10-29T02:51:34.700ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136572026-10-29T02:51:34.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
136582026-10-29T02:51:34.703ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
136592026-10-29T02:51:34.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
136602026-10-29T02:51:34.705ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
136612026-10-29T02:51:34.705ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 15.149105ms iteration = 41 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
136622026-10-29T02:51:34.777ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = cd4ebd71-78bc-4c03-9587-d5b137def4e0 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
136632026-10-29T02:51:34.777ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136642026-10-29T02:51:34.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136652026-10-29T02:51:34.780ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(63f32cdd-9518-4a2a-949d-5cfd979654cb, 0), (9a3e2159-904d-4a43-ad6f-208498b145f0, 0), (d76d23d2-b342-49a2-a57b-b3d0258cc16c, 0), (bd0a7fbc-2166-40a8-ac88-d066673b1c53, 0)] collection_id = 63f32cdd-9518-4a2a-949d-5cfd979654cb
136662026-10-29T02:51:34.780ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136672026-10-29T02:51:34.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136682026-10-29T02:51:34.864ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 63f32cdd-9518-4a2a-949d-5cfd979654cb file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
136692026-10-29T02:51:34.865ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136702026-10-29T02:51:34.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136712026-10-29T02:51:34.868ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(9a3e2159-904d-4a43-ad6f-208498b145f0, 0), (d76d23d2-b342-49a2-a57b-b3d0258cc16c, 0), (bd0a7fbc-2166-40a8-ac88-d066673b1c53, 0), (6cd12faf-728b-4184-a999-7aceff377023, 0)] collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0
136722026-10-29T02:51:34.868ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136732026-10-29T02:51:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136742026-10-29T02:51:34.935ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 9a3e2159-904d-4a43-ad6f-208498b145f0 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 102 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
136752026-10-29T02:51:34.936ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
136762026-10-29T02:51:34.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
136772026-10-29T02:51:34.939ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(d76d23d2-b342-49a2-a57b-b3d0258cc16c, 0), (bd0a7fbc-2166-40a8-ac88-d066673b1c53, 0), (6cd12faf-728b-4184-a999-7aceff377023, 0)]
136782026-10-29T02:51:34.939ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 618287659 } })
136792026-10-29T02:51:34.940ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 619343101 } })
136802026-10-29T02:51:34.941ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
136812026-10-29T02:51:34.941ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
136822026-10-29T02:51:34.941ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
136832026-10-29T02:51:34.941ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "663e34f8-11e2-4d12-bf1b-987fefb49d95", "content-length": "50", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136842026-10-29T02:51:34.941ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
136852026-10-29T02:51:34.942ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7ff9a82-a0a9-4aae-8ded-5ea800e8fb80", "content-length": "681", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136862026-10-29T02:51:34.942ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
136872026-10-29T02:51:34.942ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8954d27f-d52b-4192-a16c-968bc53917f5", "content-length": "734", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136882026-10-29T02:51:34.942ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
136892026-10-29T02:51:34.943ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd0bc2a-5094-42ec-a029-f918622616d6", "content-length": "111", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136902026-10-29T02:51:34.944ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
136912026-10-29T02:51:34.944ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab421475-3e23-4c1a-a49d-533bb60d177a", "content-length": "111", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136922026-10-29T02:51:34.944ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
136932026-10-29T02:51:34.945ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aa91ab6-7483-49a4-be47-d2e8a8f8a4e5", "content-length": "163", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136942026-10-29T02:51:34.945ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
136952026-10-29T02:51:34.946ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "76a7996c-f253-4610-928e-f95ae0f74469", "content-length": "163", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136962026-10-29T02:51:34.946ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
136972026-10-29T02:51:34.947ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c983d8a-edea-4dca-8c9e-7150fd1dc7af", "content-length": "166", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
136982026-10-29T02:51:34.947ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
136992026-10-29T02:51:34.948ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a8191fa-bd7b-475d-900c-f49c26fc0b84", "content-length": "166", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137002026-10-29T02:51:34.948ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
137012026-10-29T02:51:34.948ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cebc9907-71c4-4b7e-b4c9-770be4b12cc7", "content-length": "702", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137022026-10-29T02:51:34.948ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
137032026-10-29T02:51:34.948ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "753defa2-6663-47f7-bdd7-82f1fdc823b2", "content-length": "727", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137042026-10-29T02:51:34.948ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
137052026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c81a9e2-431b-4e68-b330-be5b744ab3dd", "content-length": "729", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137062026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
137072026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "74394c17-d26b-4b9e-955b-b0f87523b754", "content-length": "728", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137082026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
137092026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b4b4d7-071f-43a7-adff-a296c9a05598", "content-length": "722", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137102026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
137112026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "91ebeb32-be7b-488f-b416-a9ad58af46f7", "content-length": "10", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137122026-10-29T02:51:34.949ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
137132026-10-29T02:51:34.950ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1251266d-a481-4217-86dc-926d4ff33bb3", "content-length": "144", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137142026-10-29T02:51:34.950ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
137152026-10-29T02:51:34.950ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5905d02-e8a0-41b8-b03f-e762182abf41", "content-length": "147", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137162026-10-29T02:51:34.950ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
137172026-10-29T02:51:34.951ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "661017ec-3a73-45fe-bd8c-7d289ce3bbe5", "content-length": "109", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137182026-10-29T02:51:34.951ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
137192026-10-29T02:51:34.951ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffe99e0e-975a-4fcc-b31f-753b1a971fc8", "content-length": "109", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137202026-10-29T02:51:34.951ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
137212026-10-29T02:51:34.952ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6edb2610-50f7-42b5-bfb5-67625bb0190b", "content-length": "163", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137222026-10-29T02:51:34.952ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
137232026-10-29T02:51:34.953ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7672f4e-e00d-423a-b966-14ca4379ec80", "content-length": "163", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137242026-10-29T02:51:34.953ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
137252026-10-29T02:51:34.953ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5e73335-f8ea-4be3-91f5-4abc83895992", "content-length": "166", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137262026-10-29T02:51:34.953ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
137272026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d59ddcbe-7b0d-40b8-bb44-c0d13e4702b0", "content-length": "166", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137282026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
137292026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a464677-628e-4b1d-bb65-07ab98fe7fb0", "content-length": "702", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137302026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
137312026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "10d82268-92be-49fc-b73e-52ca9be2d18f", "content-length": "727", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137322026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
137332026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8dfc63a-8075-49b8-833e-90c2a94da6f1", "content-length": "729", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137342026-10-29T02:51:34.954ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
137352026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "257bb3ff-0377-407f-b501-50625cb6ed18", "content-length": "728", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137362026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
137372026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90491667-f8c4-49ac-b577-6939740e3834", "content-length": "722", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137382026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
137392026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "70881191-01cb-4226-9bc9-f80f11fe1b41", "content-length": "10", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137402026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
137412026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbd58817-7a94-49da-801b-ea90e356f7c8", "content-length": "144", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137422026-10-29T02:51:34.955ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
137432026-10-29T02:51:34.956ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa72efff-c140-4af6-b2f4-1e25dc213228", "content-length": "147", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137442026-10-29T02:51:34.956ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
137452026-10-29T02:51:34.956ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30efaebf-3a1f-43fc-b235-86055dbff25f", "content-length": "109", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137462026-10-29T02:51:34.956ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
137472026-10-29T02:51:34.957ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "99cefa52-5c6e-4d5e-8f3b-9bdc420b5e8c", "content-length": "109", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137482026-10-29T02:51:34.957ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
137492026-10-29T02:51:34.957ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3925cc8a-f075-40de-8685-0ea4a225fb9f", "content-length": "163", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137502026-10-29T02:51:34.957ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
137512026-10-29T02:51:34.958ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "82ee3956-d5b0-41a0-940b-35df3ccf59d0", "content-length": "163", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137522026-10-29T02:51:34.958ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
137532026-10-29T02:51:34.959ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "841abdde-d751-4d86-8595-2658c525b26c", "content-length": "166", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137542026-10-29T02:51:34.959ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
137552026-10-29T02:51:34.959ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a34088ec-4fd0-4d84-9026-a017bff0a4b8", "content-length": "166", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137562026-10-29T02:51:34.959ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
137572026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "32ec792a-913b-46ef-a230-f65d7986938d", "content-length": "702", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137582026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
137592026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c865112d-a382-4d60-bb0f-a8f6096b64aa", "content-length": "727", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137602026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
137612026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "30277bcf-13c6-4444-b603-fb2146527749", "content-length": "729", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137622026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
137632026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "809d364b-35c6-447d-bdd4-852aa91d8329", "content-length": "728", "date": "Thu, 29 Oct 2026 02:51:34 GMT"} })
137642026-10-29T02:51:34.960ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
137652026-10-29T02:51:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
137662026-10-29T02:51:34.963ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137672026-10-29T02:51:34.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
137682026-10-29T02:51:34.965ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
137692026-10-29T02:51:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
137702026-10-29T02:51:34.967ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137712026-10-29T02:51:34.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
137722026-10-29T02:51:34.970ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
137732026-10-29T02:51:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
137742026-10-29T02:51:34.972ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
137752026-10-29T02:51:34.972ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
137762026-10-29T02:51:35.034ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2066f07e-4f65-491d-b867-01211a14de7c", "content-length": "93890", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137772026-10-29T02:51:35.035ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
137782026-10-29T02:51:35.035ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
137792026-10-29T02:51:35.035ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
137802026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
137812026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
137822026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
137832026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
137842026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
137852026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d3f215-c4df-419a-b7a1-ed1446ded809", "content-length": "64", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137862026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75b3e07-e145-4038-9582-df732221b40d", "content-length": "64", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137872026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
137882026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec21135-0bec-489d-bb0a-6d8f63cbee71", "content-length": "64", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137892026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13b022f7-a284-4a17-8e0b-587ab77f56c4", "content-length": "64", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137902026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
137912026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
137922026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
137932026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f009a31-7c6f-4d43-abd9-c5afbdbfe305", "content-length": "64", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137942026-10-29T02:51:35.035ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
137952026-10-29T02:51:35.041ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "166211b7-6702-4492-a683-0ec94c904fbf", "content-length": "421643", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137962026-10-29T02:51:35.042ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "03531ad0-2f77-4e91-9523-1fe7d560625f", "content-length": "425801", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137972026-10-29T02:51:35.042ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "509d9fa0-743f-4747-abed-d26bcafed3c8", "content-length": "435114", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137982026-10-29T02:51:35.042ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "19614c45-5364-4051-9863-963b7d7dce23", "content-length": "422242", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
137992026-10-29T02:51:35.042ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "cde22bee-4f55-45c9-9bf0-9d88e1a41485", "content-length": "422605", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
138002026-10-29T02:51:35.046ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
138012026-10-29T02:51:35.046ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
138022026-10-29T02:51:35.046ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
138032026-10-29T02:51:35.046ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
138042026-10-29T02:51:35.046ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
138052026-10-29T02:51:35.047ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
138062026-10-29T02:51:35.047ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
138072026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f665f97-c2fc-4636-a8e1-474f824d327b", "content-length": "258", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
138082026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
138092026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
138102026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
138112026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
138122026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
138132026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
138142026-10-29T02:51:35.050ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
138152026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f12d8125-6735-4a5f-8816-5b36bc0632a8", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
138162026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbbd63e5-3f12-4ec3-8db0-1577705d30aa", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
138172026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
138182026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
138192026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f61b45dc-ca54-4d97-8f64-3dec8f751ff8", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:51:35 GMT"} })
138202026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
138212026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
138222026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
138232026-10-29T02:51:35.051ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
138242026-10-29T02:51:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
138252026-10-29T02:51:35.054ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138262026-10-29T02:51:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
138272026-10-29T02:51:35.057ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
138282026-10-29T02:51:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
138292026-10-29T02:51:35.294ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 file = nexus/db-queries/src/db/datastore/inventory.rs:2241
138302026-10-29T02:51:35.294ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 time_started = 2026-10-29 02:51:34.941486 UTC
138312026-10-29T02:51:35.294ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 70 reason = Dependency
138322026-10-29T02:51:35.294ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
138332026-10-29T02:51:35.294ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 604.040885ms iteration = 16 status = {"collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","time_done":"2026-10-29 02:51:35.051672 UTC","time_started":"2026-10-29 02:51:34.941486 UTC"}
138342026-10-29T02:51:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
138352026-10-29T02:51:35.297ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138362026-10-29T02:51:35.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
138372026-10-29T02:51:35.301ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
138382026-10-29T02:51:35.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
138392026-10-29T02:51:35.303ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
138402026-10-29T02:51:35.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
138412026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 86.61957ms iteration = 70 status = {"Loaded":{"collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","time_loaded":"2026-10-29T02:51:35.294689363Z","time_started":"2026-10-29T02:51:34.941486Z"}}
138422026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 37 reason = Dependency
138432026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 32 reason = Dependency
138442026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 35 reason = Dependency
138452026-10-29T02:51:35.381ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
138462026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 7.761\u{b5}s iteration = 35 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
138472026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 25 reason = Dependency
138482026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
138492026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 48 reason = Dependency
138502026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
138512026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138522026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
138532026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
138542026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
138552026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138562026-10-29T02:51:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
138572026-10-29T02:51:35.383ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138582026-10-29T02:51:35.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138592026-10-29T02:51:35.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138602026-10-29T02:51:35.385ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138612026-10-29T02:51:35.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138622026-10-29T02:51:35.388ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138632026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138642026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
138652026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
138662026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
138672026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
138682026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
138692026-10-29T02:51:35.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
138702026-10-29T02:51:35.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
138712026-10-29T02:51:35.390ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
138722026-10-29T02:51:35.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
138732026-10-29T02:51:35.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138742026-10-29T02:51:35.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138752026-10-29T02:51:35.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138762026-10-29T02:51:35.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138772026-10-29T02:51:35.393ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138782026-10-29T02:51:35.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138792026-10-29T02:51:35.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
138802026-10-29T02:51:35.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
138812026-10-29T02:51:35.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
138822026-10-29T02:51:35.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
138832026-10-29T02:51:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
138842026-10-29T02:51:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
138852026-10-29T02:51:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138862026-10-29T02:51:35.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138872026-10-29T02:51:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138882026-10-29T02:51:35.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
138892026-10-29T02:51:35.397ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
138902026-10-29T02:51:35.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
138912026-10-29T02:51:35.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
138922026-10-29T02:51:35.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
138932026-10-29T02:51:35.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
138942026-10-29T02:51:35.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
138952026-10-29T02:51:35.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138962026-10-29T02:51:35.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138972026-10-29T02:51:35.401ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
138982026-10-29T02:51:35.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
138992026-10-29T02:51:35.402ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139002026-10-29T02:51:35.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139012026-10-29T02:51:35.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139022026-10-29T02:51:35.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139032026-10-29T02:51:35.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139042026-10-29T02:51:35.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
139052026-10-29T02:51:35.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139062026-10-29T02:51:35.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139072026-10-29T02:51:35.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139082026-10-29T02:51:35.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139092026-10-29T02:51:35.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139102026-10-29T02:51:35.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139112026-10-29T02:51:35.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139122026-10-29T02:51:35.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139132026-10-29T02:51:35.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139142026-10-29T02:51:35.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139152026-10-29T02:51:35.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
139162026-10-29T02:51:35.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139172026-10-29T02:51:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139182026-10-29T02:51:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
139192026-10-29T02:51:35.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139202026-10-29T02:51:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139212026-10-29T02:51:35.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139222026-10-29T02:51:35.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139232026-10-29T02:51:35.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139242026-10-29T02:51:35.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139252026-10-29T02:51:35.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139262026-10-29T02:51:35.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139272026-10-29T02:51:35.415ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 34.065238ms iteration = 48 status = {"disks_added":0,"errors":[]}
139282026-10-29T02:51:35.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139292026-10-29T02:51:35.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139302026-10-29T02:51:35.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139312026-10-29T02:51:35.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139322026-10-29T02:51:35.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
139332026-10-29T02:51:35.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139342026-10-29T02:51:35.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139352026-10-29T02:51:35.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139362026-10-29T02:51:35.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139372026-10-29T02:51:35.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139382026-10-29T02:51:35.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139392026-10-29T02:51:35.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139402026-10-29T02:51:35.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139412026-10-29T02:51:35.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139422026-10-29T02:51:35.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139432026-10-29T02:51:35.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139442026-10-29T02:51:35.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139452026-10-29T02:51:35.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
139462026-10-29T02:51:35.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139472026-10-29T02:51:35.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139482026-10-29T02:51:35.428ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
139492026-10-29T02:51:35.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139502026-10-29T02:51:35.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139512026-10-29T02:51:35.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139522026-10-29T02:51:35.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139532026-10-29T02:51:35.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139542026-10-29T02:51:35.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139552026-10-29T02:51:35.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139562026-10-29T02:51:35.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139572026-10-29T02:51:35.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139582026-10-29T02:51:35.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139592026-10-29T02:51:35.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
139602026-10-29T02:51:35.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139612026-10-29T02:51:35.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139622026-10-29T02:51:35.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139632026-10-29T02:51:35.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139642026-10-29T02:51:35.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139652026-10-29T02:51:35.439ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
139662026-10-29T02:51:35.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139672026-10-29T02:51:35.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139682026-10-29T02:51:35.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139692026-10-29T02:51:35.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139702026-10-29T02:51:35.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139712026-10-29T02:51:35.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139722026-10-29T02:51:35.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139732026-10-29T02:51:35.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
139742026-10-29T02:51:35.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
139752026-10-29T02:51:35.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
139762026-10-29T02:51:35.449ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
139772026-10-29T02:51:35.450ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
139782026-10-29T02:51:35.450ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 24 reason = Dependency
139792026-10-29T02:51:35.450ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
139802026-10-29T02:51:35.450ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 68.764609ms iteration = 25 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
139812026-10-29T02:51:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
139822026-10-29T02:51:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
139832026-10-29T02:51:35.450ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
139842026-10-29T02:51:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
139852026-10-29T02:51:35.452ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139862026-10-29T02:51:35.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
139872026-10-29T02:51:35.454ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
139882026-10-29T02:51:35.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
139892026-10-29T02:51:35.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139902026-10-29T02:51:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139912026-10-29T02:51:35.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139922026-10-29T02:51:35.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
139932026-10-29T02:51:35.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139942026-10-29T02:51:35.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139952026-10-29T02:51:35.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
139962026-10-29T02:51:35.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
139972026-10-29T02:51:35.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139982026-10-29T02:51:35.500ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
139992026-10-29T02:51:35.500ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 50.083781ms iteration = 24 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
140002026-10-29T02:51:35.500ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 38 reason = Dependency
140012026-10-29T02:51:35.500ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
140022026-10-29T02:51:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
140032026-10-29T02:51:35.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
140042026-10-29T02:51:35.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140052026-10-29T02:51:35.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140062026-10-29T02:51:35.501ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140072026-10-29T02:51:35.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140082026-10-29T02:51:35.505ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
140092026-10-29T02:51:35.505ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 5.630617ms iteration = 38 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
140102026-10-29T02:51:35.506ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140112026-10-29T02:51:35.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
140122026-10-29T02:51:35.511ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140132026-10-29T02:51:35.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140142026-10-29T02:51:35.514ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140152026-10-29T02:51:35.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140162026-10-29T02:51:35.516ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140172026-10-29T02:51:35.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
140182026-10-29T02:51:35.519ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140192026-10-29T02:51:35.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140202026-10-29T02:51:35.522ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140212026-10-29T02:51:35.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140222026-10-29T02:51:35.524ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140232026-10-29T02:51:35.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
140242026-10-29T02:51:35.527ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140252026-10-29T02:51:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140262026-10-29T02:51:35.529ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
140272026-10-29T02:51:35.529ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140282026-10-29T02:51:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140292026-10-29T02:51:35.531ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140302026-10-29T02:51:35.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
140312026-10-29T02:51:35.534ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
140322026-10-29T02:51:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
140332026-10-29T02:51:35.537ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
140342026-10-29T02:51:35.537ZINFOnexus (BackgroundTasks): building sitrep 30894f38-a4b8-461d-b915-11d6cf15b260 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 30894f38-a4b8-461d-b915-11d6cf15b260 (sitrep)
140352026-10-29T02:51:35.537ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
140362026-10-29T02:51:35.537ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 156.593125ms iteration = 32 status = {"inv_collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:51:35.537870237Z","outcome":"Unchanged","start_time":"2026-10-29T02:51:35.537845267Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
140372026-10-29T02:51:35.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140382026-10-29T02:51:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140392026-10-29T02:51:35.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140402026-10-29T02:51:35.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
140412026-10-29T02:51:35.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140422026-10-29T02:51:35.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140432026-10-29T02:51:35.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140442026-10-29T02:51:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140452026-10-29T02:51:35.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140462026-10-29T02:51:35.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140472026-10-29T02:51:35.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140482026-10-29T02:51:35.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
140492026-10-29T02:51:35.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140502026-10-29T02:51:35.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140512026-10-29T02:51:35.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140522026-10-29T02:51:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140532026-10-29T02:51:35.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140542026-10-29T02:51:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
140552026-10-29T02:51:35.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140562026-10-29T02:51:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140572026-10-29T02:51:35.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140582026-10-29T02:51:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140592026-10-29T02:51:35.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140602026-10-29T02:51:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
140612026-10-29T02:51:35.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140622026-10-29T02:51:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140632026-10-29T02:51:35.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140642026-10-29T02:51:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140652026-10-29T02:51:35.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140662026-10-29T02:51:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
140672026-10-29T02:51:35.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140682026-10-29T02:51:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140692026-10-29T02:51:35.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140702026-10-29T02:51:35.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140712026-10-29T02:51:35.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140722026-10-29T02:51:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
140732026-10-29T02:51:35.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140742026-10-29T02:51:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140752026-10-29T02:51:35.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140762026-10-29T02:51:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140772026-10-29T02:51:35.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140782026-10-29T02:51:35.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
140792026-10-29T02:51:35.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140802026-10-29T02:51:35.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140812026-10-29T02:51:35.611ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
140822026-10-29T02:51:35.611ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
140832026-10-29T02:51:35.611ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = d5b50502-d384-4863-a2cb-a2bc27410791 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
140842026-10-29T02:51:35.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140852026-10-29T02:51:35.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140862026-10-29T02:51:35.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140872026-10-29T02:51:35.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
140882026-10-29T02:51:35.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
140892026-10-29T02:51:35.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
140902026-10-29T02:51:35.619ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 2 limit = 5000 usage_percent = 0
140912026-10-29T02:51:35.619ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
140922026-10-29T02:51:35.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 238.466267ms iteration = 37 status = {"Unchanged":{"blueprint_count":2,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
140932026-10-29T02:51:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 158 reason = Timeout
140942026-10-29T02:51:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
140952026-10-29T02:51:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
140962026-10-29T02:51:38.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140972026-10-29T02:51:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
140982026-10-29T02:51:38.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
140992026-10-29T02:51:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141002026-10-29T02:51:38.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
141012026-10-29T02:51:38.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.787463ms iteration = 158 status = {"config_updated":false}
141022026-10-29T02:51:40.620ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 189 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = e905e6f1-2112-4341-addf-d8500b3261ea response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
141032026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 159 reason = Timeout
141042026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
141052026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
141062026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141072026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
141082026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141092026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141102026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141112026-10-29T02:51:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141122026-10-29T02:51:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141132026-10-29T02:51:43.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141142026-10-29T02:51:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141152026-10-29T02:51:43.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141162026-10-29T02:51:43.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.452782ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
141172026-10-29T02:51:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
141182026-10-29T02:51:43.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
141192026-10-29T02:51:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141202026-10-29T02:51:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141212026-10-29T02:51:43.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141222026-10-29T02:51:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141232026-10-29T02:51:43.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
141242026-10-29T02:51:43.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.901905ms iteration = 159 status = {"config_updated":false}
141252026-10-29T02:51:43.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141262026-10-29T02:51:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141272026-10-29T02:51:43.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141282026-10-29T02:51:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
141292026-10-29T02:51:43.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141302026-10-29T02:51:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141312026-10-29T02:51:43.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
141322026-10-29T02:51:43.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.16817ms iteration = 80 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
141332026-10-29T02:51:48.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 160 reason = Timeout
141342026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
141352026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 71 reason = Timeout
141362026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
141372026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 56 reason = Timeout
141382026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 54 reason = Timeout
141392026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
141402026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
141412026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141422026-10-29T02:51:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
141432026-10-29T02:51:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
141442026-10-29T02:51:48.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
141452026-10-29T02:51:48.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141462026-10-29T02:51:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141472026-10-29T02:51:48.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141482026-10-29T02:51:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141492026-10-29T02:51:48.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
141502026-10-29T02:51:48.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
141512026-10-29T02:51:48.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
141522026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
141532026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
141542026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141552026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
141562026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
141572026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
141582026-10-29T02:51:48.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
141592026-10-29T02:51:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
141602026-10-29T02:51:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
141612026-10-29T02:51:48.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
141622026-10-29T02:51:48.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 9.254402ms iteration = 56 status = {"Loaded":{"time_loaded":"2026-10-29T02:51:48.726062155Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
141632026-10-29T02:51:48.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
141642026-10-29T02:51:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.63981ms iteration = 160 status = {"config_updated":false}
141652026-10-29T02:51:48.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 original_time_started = 2026-10-29 02:51:34.941486 UTC
141662026-10-29T02:51:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.657681ms iteration = 71 status = {"Loaded":{"collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","time_loaded":"2026-10-29T02:51:48.726011594Z","time_started":"2026-10-29T02:51:34.941486Z"}}
141672026-10-29T02:51:48.736ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
141682026-10-29T02:51:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 10.806185ms iteration = 54 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
141692026-10-29T02:51:49.186ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 94594dc0-e30c-4a85-b5da-5c77b04376e9 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
141702026-10-29T02:51:49.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 94594dc0-e30c-4a85-b5da-5c77b04376e9 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
141712026-10-29T02:51:49.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 94594dc0-e30c-4a85-b5da-5c77b04376e9 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
141722026-10-29T02:51:49.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 4440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 94594dc0-e30c-4a85-b5da-5c77b04376e9 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
141732026-10-29T02:51:49.191ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 31221eb9-888c-4987-9c09-fab9ac55f143 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
141742026-10-29T02:51:49.191ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 31221eb9-888c-4987-9c09-fab9ac55f143 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
141752026-10-29T02:51:49.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 31221eb9-888c-4987-9c09-fab9ac55f143 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
141762026-10-29T02:51:49.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52227 req_id = 31221eb9-888c-4987-9c09-fab9ac55f143 response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
141772026-10-29T02:51:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 116 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 008b03b3-2c54-4ed5-93d0-051d48e93fe9 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
141782026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 161 reason = Timeout
141792026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
141802026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
141812026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141822026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
141832026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141842026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141852026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141862026-10-29T02:51:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141872026-10-29T02:51:53.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141882026-10-29T02:51:53.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141892026-10-29T02:51:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
141902026-10-29T02:51:53.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
141912026-10-29T02:51:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141922026-10-29T02:51:53.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141932026-10-29T02:51:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
141942026-10-29T02:51:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141952026-10-29T02:51:53.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
141962026-10-29T02:51:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.063098ms iteration = 161 status = {"config_updated":false}
141972026-10-29T02:51:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141982026-10-29T02:51:53.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
141992026-10-29T02:51:53.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142002026-10-29T02:51:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
142012026-10-29T02:51:53.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142022026-10-29T02:51:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
142032026-10-29T02:51:53.760ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
142042026-10-29T02:51:53.760ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.042007ms iteration = 81 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
142052026-10-29T02:51:53.779ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142062026-10-29T02:51:53.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142072026-10-29T02:51:53.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.425922ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142082026-10-29T02:51:58.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 162 reason = Timeout
142092026-10-29T02:51:58.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
142102026-10-29T02:51:58.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
142112026-10-29T02:51:58.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142122026-10-29T02:51:58.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
142132026-10-29T02:51:58.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
142142026-10-29T02:51:58.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
142152026-10-29T02:51:58.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
142162026-10-29T02:51:58.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.398365ms iteration = 162 status = {"config_updated":false}
142172026-10-29T02:52:00.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 126 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 164943c9-0a6d-402f-b8bb-69b02ec5827f response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
142182026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 163 reason = Timeout
142192026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 42 reason = Timeout
142202026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
142212026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
142222026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
142232026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142242026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 55 reason = Timeout
142252026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
142262026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
142272026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
142282026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 57 reason = Timeout
142292026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 49 reason = Timeout
142302026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
142312026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142322026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 42 reason = Timeout
142332026-10-29T02:52:03.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
142342026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142352026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 72 reason = Timeout
142362026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
142372026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
142382026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142392026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
142402026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
142412026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
142422026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142432026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
142442026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
142452026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 28 reason = Timeout
142462026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
142472026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 28 reason = Timeout
142482026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
142492026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
142502026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
142512026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142522026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
142532026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
142542026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
142552026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
142562026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
142572026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
142582026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
142592026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 28 reason = Timeout
142602026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142612026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
142622026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
142632026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142642026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142652026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
142662026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
142672026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
142682026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142692026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
142702026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
142712026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
142722026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
142732026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
142742026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
142752026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
142762026-10-29T02:52:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 405346108 } })
142772026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
142782026-10-29T02:52:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 405374389 } })
142792026-10-29T02:52:03.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 405425540 } })
142802026-10-29T02:52:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
142812026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
142822026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
142832026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "adcdd48a-753d-4620-8d30-4f0cc04df80d", "content-length": "50", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
142842026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "753f70b3-5401-49ba-bb53-4a5639206fc6", "content-length": "50", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
142852026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
142862026-10-29T02:52:03.727ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
142872026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
142882026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.367708ms iteration = 28 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
142892026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
142902026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfcbe3da-5fef-4eef-b07f-f2c10fd1c0cb", "content-length": "681", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
142912026-10-29T02:52:03.727ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
142922026-10-29T02:52:03.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
142932026-10-29T02:52:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
142942026-10-29T02:52:03.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
142952026-10-29T02:52:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
142962026-10-29T02:52:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
142972026-10-29T02:52:03.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
142982026-10-29T02:52:03.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.88479ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
142992026-10-29T02:52:03.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143002026-10-29T02:52:03.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.33702ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
143012026-10-29T02:52:03.729ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 408237278 } })
143022026-10-29T02:52:03.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143032026-10-29T02:52:03.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143042026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143052026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143062026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143072026-10-29T02:52:03.730ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
143082026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 4.235758ms iteration = 28 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
143092026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.427812ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
143102026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143112026-10-29T02:52:03.730ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143122026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
143132026-10-29T02:52:03.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143142026-10-29T02:52:03.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
143152026-10-29T02:52:03.731ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
143162026-10-29T02:52:03.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
143172026-10-29T02:52:03.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143182026-10-29T02:52:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.496775ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
143192026-10-29T02:52:03.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
143202026-10-29T02:52:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
143212026-10-29T02:52:03.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
143222026-10-29T02:52:03.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
143232026-10-29T02:52:03.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143242026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
143252026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
143262026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143272026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
143282026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143292026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143302026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
143312026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143322026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
143332026-10-29T02:52:03.737ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
143342026-10-29T02:52:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
143352026-10-29T02:52:03.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
143362026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
143372026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
143382026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
143392026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
143402026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
143412026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143422026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
143432026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143442026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
143452026-10-29T02:52:03.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143462026-10-29T02:52:03.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143472026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
143482026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 15.169996ms iteration = 163 status = {"config_updated":false}
143492026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
143502026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 original_time_started = 2026-10-29 02:51:34.941486 UTC
143512026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 15.066713ms iteration = 72 status = {"Loaded":{"collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","time_loaded":"2026-10-29T02:52:03.726121432Z","time_started":"2026-10-29T02:51:34.941486Z"}}
143522026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 15.142144ms iteration = 55 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
143532026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
143542026-10-29T02:52:03.741ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
143552026-10-29T02:52:03.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143562026-10-29T02:52:03.742ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "83b8c095-750a-435c-a2e6-362439cb2f33", "content-length": "81", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
143572026-10-29T02:52:03.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143582026-10-29T02:52:03.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
143592026-10-29T02:52:03.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143602026-10-29T02:52:03.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143612026-10-29T02:52:03.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143622026-10-29T02:52:03.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143632026-10-29T02:52:03.745ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
143642026-10-29T02:52:03.745ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.288841ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
143652026-10-29T02:52:03.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
143662026-10-29T02:52:03.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143672026-10-29T02:52:03.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143682026-10-29T02:52:03.747ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
143692026-10-29T02:52:03.747ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
143702026-10-29T02:52:03.748ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6e267de-2596-4b79-8daa-6cc2bf01bb24", "content-length": "372", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
143712026-10-29T02:52:03.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143722026-10-29T02:52:03.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143732026-10-29T02:52:03.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143742026-10-29T02:52:03.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
143752026-10-29T02:52:03.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143762026-10-29T02:52:03.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
143772026-10-29T02:52:03.756ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
143782026-10-29T02:52:03.756ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143792026-10-29T02:52:03.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143802026-10-29T02:52:03.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143812026-10-29T02:52:03.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143822026-10-29T02:52:03.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
143832026-10-29T02:52:03.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.380014ms iteration = 82 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
143842026-10-29T02:52:03.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143852026-10-29T02:52:03.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143862026-10-29T02:52:03.813ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
143872026-10-29T02:52:03.813ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 85.65341ms iteration = 28 status = {"incomplete_bootstore_configs":[]}
143882026-10-29T02:52:03.819ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143892026-10-29T02:52:03.819ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
143902026-10-29T02:52:03.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143912026-10-29T02:52:03.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
143922026-10-29T02:52:03.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
143932026-10-29T02:52:03.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
143942026-10-29T02:52:03.822ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
143952026-10-29T02:52:03.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
143962026-10-29T02:52:03.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
143972026-10-29T02:52:03.827ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
143982026-10-29T02:52:03.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
143992026-10-29T02:52:03.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
144002026-10-29T02:52:03.827ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144012026-10-29T02:52:03.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
144022026-10-29T02:52:03.832ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
144032026-10-29T02:52:03.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
144042026-10-29T02:52:03.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144052026-10-29T02:52:03.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144062026-10-29T02:52:03.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144072026-10-29T02:52:03.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144082026-10-29T02:52:03.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.71942ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
144092026-10-29T02:52:03.836ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
144102026-10-29T02:52:03.836ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 109.933625ms iteration = 57 status = {"Loaded":{"time_loaded":"2026-10-29T02:52:03.726075881Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
144112026-10-29T02:52:03.836ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
144122026-10-29T02:52:03.836ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
144132026-10-29T02:52:03.836ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
144142026-10-29T02:52:03.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144152026-10-29T02:52:03.837ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc282ea6-a6de-4f89-94d9-6d606cecaa69", "content-length": "81", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
144162026-10-29T02:52:03.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144172026-10-29T02:52:03.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.155182ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
144182026-10-29T02:52:03.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
144192026-10-29T02:52:03.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144202026-10-29T02:52:03.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144212026-10-29T02:52:03.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
144222026-10-29T02:52:03.842ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
144232026-10-29T02:52:03.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144242026-10-29T02:52:03.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144252026-10-29T02:52:03.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
144262026-10-29T02:52:03.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144272026-10-29T02:52:03.845ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
144282026-10-29T02:52:03.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144292026-10-29T02:52:03.845ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
144302026-10-29T02:52:03.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144312026-10-29T02:52:03.846ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d71e15-de75-42f1-bdf5-b1bc98438d63", "content-length": "81", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
144322026-10-29T02:52:03.846ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
144332026-10-29T02:52:03.846ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 120.164478ms iteration = 28 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
144342026-10-29T02:52:03.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144352026-10-29T02:52:03.851ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144362026-10-29T02:52:03.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144372026-10-29T02:52:03.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144382026-10-29T02:52:03.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144392026-10-29T02:52:03.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
144402026-10-29T02:52:03.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144412026-10-29T02:52:03.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
144422026-10-29T02:52:03.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144432026-10-29T02:52:03.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
144442026-10-29T02:52:03.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144452026-10-29T02:52:03.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
144462026-10-29T02:52:03.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144472026-10-29T02:52:03.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
144482026-10-29T02:52:03.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144492026-10-29T02:52:03.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
144502026-10-29T02:52:03.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
144512026-10-29T02:52:03.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d305ea9-f482-4818-87f2-6b25b03f09e4", "content-length": "691", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
144522026-10-29T02:52:03.888ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
144532026-10-29T02:52:03.888ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
144542026-10-29T02:52:03.888ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
144552026-10-29T02:52:03.888ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 156.375561ms iteration = 28 status = {}
144562026-10-29T02:52:03.889ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
144572026-10-29T02:52:03.889ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
144582026-10-29T02:52:03.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6083ff5f-b26f-4a22-9950-7b343c40ae11", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
144592026-10-29T02:52:03.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144602026-10-29T02:52:03.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144612026-10-29T02:52:03.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144622026-10-29T02:52:03.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144632026-10-29T02:52:03.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144642026-10-29T02:52:03.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144652026-10-29T02:52:03.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144662026-10-29T02:52:03.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144672026-10-29T02:52:03.902ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
144682026-10-29T02:52:03.902ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
144692026-10-29T02:52:03.902ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8db075a4-ea3b-43b9-8c99-496af3ab343c", "date": "Thu, 29 Oct 2026 02:52:03 GMT"} })
144702026-10-29T02:52:03.902ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 176.375976ms iteration = 42 status = {}
144712026-10-29T02:52:03.912ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
144722026-10-29T02:52:03.912ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
144732026-10-29T02:52:03.912ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.371784ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
144742026-10-29T02:52:03.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144752026-10-29T02:52:03.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144762026-10-29T02:52:03.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 192.46084ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
144772026-10-29T02:52:03.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144782026-10-29T02:52:03.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
144792026-10-29T02:52:03.923ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144802026-10-29T02:52:03.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144812026-10-29T02:52:03.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144822026-10-29T02:52:03.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144832026-10-29T02:52:03.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144842026-10-29T02:52:03.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144852026-10-29T02:52:03.946ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144862026-10-29T02:52:03.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144872026-10-29T02:52:03.951ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 225.261993ms iteration = 49 status = {"disks_added":0,"errors":[]}
144882026-10-29T02:52:03.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 233.434622ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
144892026-10-29T02:52:03.979ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
144902026-10-29T02:52:03.979ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 253.720963ms iteration = 42 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
144912026-10-29T02:52:04.719ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
144922026-10-29T02:52:04.719ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
144932026-10-29T02:52:04.719ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST operation_id = cpapi_producers_post uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
144942026-10-29T02:52:04.719ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:1057 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:46427
144952026-10-29T02:52:04.719ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46427 req_id = 5a36e2d7-7334-4902-ad6b-705cca0121a8 uri = /metrics/producers version = 1.0.0
144962026-10-29T02:52:04.719ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46427 req_id = 5a36e2d7-7334-4902-ad6b-705cca0121a8 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
144972026-10-29T02:52:04.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46427 req_id = 5a36e2d7-7334-4902-ad6b-705cca0121a8 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
144982026-10-29T02:52:04.769ZINFOnexus: assigned collector to new producer collector_id = 8a46c129-dc41-46f0-b0fe-5dc9b5402b19 file = nexus/src/app/oximeter.rs:78 producer_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7
144992026-10-29T02:52:04.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 49860 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46427 req_id = 5a36e2d7-7334-4902-ad6b-705cca0121a8 response_code = 201 uri = /metrics/producers
145002026-10-29T02:52:04.769ZDEBGnexus (producer-registration-task): client response operation_id = cpapi_producers_post result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "5a36e2d7-7334-4902-ad6b-705cca0121a8", "content-length": "41", "date": "Thu, 29 Oct 2026 02:52:04 GMT"} })
145012026-10-29T02:52:04.769ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
145022026-10-29T02:52:08.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 164 reason = Timeout
145032026-10-29T02:52:08.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145042026-10-29T02:52:08.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145052026-10-29T02:52:08.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145062026-10-29T02:52:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
145072026-10-29T02:52:08.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145082026-10-29T02:52:08.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145092026-10-29T02:52:08.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
145102026-10-29T02:52:08.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.000867ms iteration = 164 status = {"config_updated":false}
145112026-10-29T02:52:10.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 126 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 3a747509-5079-423c-a7e0-42e85ce9c0dd response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
145122026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 165 reason = Timeout
145132026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145142026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
145152026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
145162026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145172026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145182026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145192026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145202026-10-29T02:52:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
145212026-10-29T02:52:13.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145222026-10-29T02:52:13.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145232026-10-29T02:52:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145242026-10-29T02:52:13.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145252026-10-29T02:52:13.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.35938ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145262026-10-29T02:52:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
145272026-10-29T02:52:13.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145282026-10-29T02:52:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145292026-10-29T02:52:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
145302026-10-29T02:52:13.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145312026-10-29T02:52:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
145322026-10-29T02:52:13.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
145332026-10-29T02:52:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.12098ms iteration = 165 status = {"config_updated":false}
145342026-10-29T02:52:13.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145352026-10-29T02:52:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
145362026-10-29T02:52:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145372026-10-29T02:52:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
145382026-10-29T02:52:13.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145392026-10-29T02:52:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
145402026-10-29T02:52:13.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
145412026-10-29T02:52:13.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.299092ms iteration = 83 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
145422026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 166 reason = Timeout
145432026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145442026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 73 reason = Timeout
145452026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 58 reason = Timeout
145462026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
145472026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
145482026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 56 reason = Timeout
145492026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
145502026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145512026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
145522026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
145532026-10-29T02:52:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
145542026-10-29T02:52:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145552026-10-29T02:52:18.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145562026-10-29T02:52:18.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145572026-10-29T02:52:18.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145582026-10-29T02:52:18.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
145592026-10-29T02:52:18.733ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
145602026-10-29T02:52:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
145612026-10-29T02:52:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
145622026-10-29T02:52:18.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
145632026-10-29T02:52:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
145642026-10-29T02:52:18.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
145652026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
145662026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
145672026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
145682026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145692026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
145702026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 8.806463ms iteration = 58 status = {"Loaded":{"time_loaded":"2026-10-29T02:52:18.726333230Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
145712026-10-29T02:52:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145722026-10-29T02:52:18.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
145732026-10-29T02:52:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.317344ms iteration = 166 status = {"config_updated":false}
145742026-10-29T02:52:18.736ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 original_time_started = 2026-10-29 02:51:34.941486 UTC
145752026-10-29T02:52:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 10.663962ms iteration = 73 status = {"Loaded":{"collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","time_loaded":"2026-10-29T02:52:18.726300130Z","time_started":"2026-10-29T02:51:34.941486Z"}}
145762026-10-29T02:52:18.737ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
145772026-10-29T02:52:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 11.087561ms iteration = 56 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
145782026-10-29T02:52:20.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 186 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 2d7e0522-b56c-4733-8b4a-42f5d8d8e336 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
145792026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 167 reason = Timeout
145802026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145812026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
145822026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145832026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
145842026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145852026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145862026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145872026-10-29T02:52:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
145882026-10-29T02:52:23.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145892026-10-29T02:52:23.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145902026-10-29T02:52:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
145912026-10-29T02:52:23.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145922026-10-29T02:52:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
145932026-10-29T02:52:23.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
145942026-10-29T02:52:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
145952026-10-29T02:52:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
145962026-10-29T02:52:23.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
145972026-10-29T02:52:23.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.719981ms iteration = 167 status = {"config_updated":false}
145982026-10-29T02:52:23.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145992026-10-29T02:52:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
146002026-10-29T02:52:23.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146012026-10-29T02:52:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
146022026-10-29T02:52:23.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146032026-10-29T02:52:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
146042026-10-29T02:52:23.752ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
146052026-10-29T02:52:23.753ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.40459ms iteration = 84 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
146062026-10-29T02:52:23.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146072026-10-29T02:52:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146082026-10-29T02:52:23.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.324013ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146092026-10-29T02:52:28.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 168 reason = Timeout
146102026-10-29T02:52:28.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
146112026-10-29T02:52:28.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
146122026-10-29T02:52:28.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146132026-10-29T02:52:28.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
146142026-10-29T02:52:28.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
146152026-10-29T02:52:28.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
146162026-10-29T02:52:28.733ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
146172026-10-29T02:52:28.733ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.258902ms iteration = 168 status = {"config_updated":false}
146182026-10-29T02:52:30.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 183 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = a10c8446-7156-48a4-8fd1-a2a3b097fe68 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
146192026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 169 reason = Timeout
146202026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
146212026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = populate_switch_ports iteration = 29 reason = Timeout
146222026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 43 reason = Timeout
146232026-10-29T02:52:33.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
146242026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 43 reason = Timeout
146252026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146262026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
146272026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 57 reason = Timeout
146282026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
146292026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 59 reason = Timeout
146302026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 33 reason = Timeout
146312026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
146322026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
146332026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
146342026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146352026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
146362026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146372026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 74 reason = Timeout
146382026-10-29T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
146392026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
146402026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
146412026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 15 reason = Timeout
146422026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
146432026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 38 reason = Timeout
146442026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
146452026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
146462026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
146472026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
146482026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
146492026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 50 reason = Timeout
146502026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
146512026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
146522026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
146532026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
146542026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
146552026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
146562026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
146572026-10-29T02:52:33.726ZINFOnexus (BackgroundTasks): attempting to realize blueprint background_task = blueprint_executor blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/lib.rs:180
146582026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
146592026-10-29T02:52:33.726ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = ExternalNetworking step id = Ensure
146602026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
146612026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
146622026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
146632026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = probe_distributor iteration = 15 reason = Timeout
146642026-10-29T02:52:33.726ZINFOnexus (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:44
146652026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
146662026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 36 reason = Timeout
146672026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
146682026-10-29T02:52:33.726ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
146692026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 17.95\u{b5}s iteration = 36 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
146702026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
146712026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
146722026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
146732026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 39 reason = Timeout
146742026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
146752026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
146762026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
146772026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
146782026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
146792026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
146802026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
146812026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
146822026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
146832026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
146842026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 29 reason = Timeout
146852026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
146862026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
146872026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
146882026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
146892026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
146902026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
146912026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
146922026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
146932026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
146942026-10-29T02:52:33.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-10-29 02:42:33.726484568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
146952026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
146962026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 15 reason = Timeout
146972026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
146982026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
146992026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 15 reason = Timeout
147002026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
147012026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
147022026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
147032026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147042026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
147052026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
147062026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
147072026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT operation_id = dns_config_put servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
147082026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 29 reason = Timeout
147092026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147102026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
147112026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147122026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 15 reason = Timeout
147132026-10-29T02:52:33.726ZINFOnexus (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager file = nexus/src/app/background/tasks/attached_subnets.rs:415
147142026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
147152026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
147162026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
147172026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
147182026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
147192026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
147202026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
147212026-10-29T02:52:33.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4023fafc-cd1a-40d6-ad67-87a7978f5d4e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("97a05c7a-45f6-4478-90b7-92b3d6feea6d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 405562669 } })
147222026-10-29T02:52:33.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 405569089 } })
147232026-10-29T02:52:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
147242026-10-29T02:52:33.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("87f1e945-be07-43ca-ad43-f1ca04fe351e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc6fcfc8-ca05-4d49-a942-5ee642c97444.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d789e79f-8961-4aea-8010-d58ea7ccb3d2.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 405624481 } })
147252026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
147262026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
147272026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
147282026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
147292026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
147302026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
147312026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "baf97f22-155d-4e34-84f2-e47383e3b8c0", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147322026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147332026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
147342026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
147352026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
147362026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
147372026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aabfcf6c-d363-4fc4-b10f-0bee51142e3c", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147382026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147392026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147402026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
147412026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
147422026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 958.05\u{b5}s iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
147432026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
147442026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
147452026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
147462026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
147472026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
147482026-10-29T02:52:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 405908576 } })
147492026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147502026-10-29T02:52:33.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 405915117 } })
147512026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147522026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "371af24e-4d7c-41e7-91c5-6b2fc24d8505", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147532026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147542026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
147552026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7d8b0a2a-bd6b-4ee0-8d57-2ef4f1922357", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147562026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147572026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
147582026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 operation_id = dns_config_put result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "eab884cc-7352-45a0-ae93-6ac56514b326", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147592026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:174 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147602026-10-29T02:52:33.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:107 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
147612026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.261456ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
147622026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
147632026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.366558ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
147642026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
147652026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
147662026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
147672026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.620164ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
147682026-10-29T02:52:33.727ZWARNnexus (BackgroundTasks): skipping (needed!) switch port population - no dpd client found for this switch slot background_task = populate_switch_ports file = nexus/src/app/background/tasks/populate_switch_ports.rs:192 switch-slot = switch1
147692026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = populate_switch_ports elapsed = 1.990341ms iteration = 29 status = {"switch0":{"Ok":{"kind":"previously_populated"}},"switch1":{"Err":"no dpd client found"}}
147702026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = instance_watcher gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e991911-b42b-40d0-8f05-a28c83e4bcf2", "content-length": "50", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} })
147712026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e76391b-702b-4a34-8c93-51e9ca316ec7", "content-length": "50", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} })
147722026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
147732026-10-29T02:52:33.727ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
147742026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
147752026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "1069c052-000f-45d9-8da3-ee7c8acc23fb", "content-length": "681", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} })
147762026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): spawned 3 tasks to ingest SP ereports background_task = sp_ereport_ingester rack_id = f1e8ed04-7806-4028-b390-384c79e98514
147772026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
147782026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
147792026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147802026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
147812026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
147822026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
147832026-10-29T02:52:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
147842026-10-29T02:52:33.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147852026-10-29T02:52:33.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147862026-10-29T02:52:33.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147872026-10-29T02:52:33.730ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-10-29 02:42:33.726484568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
147882026-10-29T02:52:33.730ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.541104ms iteration = 15 status = {"expiration":"2026-10-29T02:42:33.726484568Z","pruned":[]}
147892026-10-29T02:52:33.730ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
147902026-10-29T02:52:33.730ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.762729ms iteration = 15 status = {"by_rx":{},"error":null}
147912026-10-29T02:52:33.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147922026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.063995ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
147932026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147942026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
147952026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): activating background_task = capacity_metrics iteration = 15 reason = Timeout
147962026-10-29T02:52:33.731ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:52
147972026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
147982026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
147992026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
148002026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
148012026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148022026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
148032026-10-29T02:52:33.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148042026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
148052026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
148062026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148072026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
148082026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
148092026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148102026-10-29T02:52:33.732ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
148112026-10-29T02:52:33.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148122026-10-29T02:52:33.734ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
148132026-10-29T02:52:33.734ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148142026-10-29T02:52:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 8.460305ms iteration = 39 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
148152026-10-29T02:52:33.734ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
148162026-10-29T02:52:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148172026-10-29T02:52:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
148182026-10-29T02:52:33.735ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148192026-10-29T02:52:33.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
148202026-10-29T02:52:33.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148212026-10-29T02:52:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148222026-10-29T02:52:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
148232026-10-29T02:52:33.736ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
148242026-10-29T02:52:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
148252026-10-29T02:52:33.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148262026-10-29T02:52:33.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148272026-10-29T02:52:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148282026-10-29T02:52:33.737ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148292026-10-29T02:52:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
148302026-10-29T02:52:33.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148312026-10-29T02:52:33.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
148322026-10-29T02:52:33.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148332026-10-29T02:52:33.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
148342026-10-29T02:52:33.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 1 sp_type = sled
148352026-10-29T02:52:33.739ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 1 sp_type = sled
148362026-10-29T02:52:33.739ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
148372026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 1 sp_type = sled
148382026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
148392026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
148402026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = sled
148412026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = sled
148422026-10-29T02:52:33.740ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 419005359 } })
148432026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
148442026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
148452026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 14.234846ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
148462026-10-29T02:52:33.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = sled
148472026-10-29T02:52:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
148482026-10-29T02:52:33.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
148492026-10-29T02:52:33.741ZERROnexus (BackgroundTasks): dendrite for switch1 is unavailable, cannot perform nat cleanup background_task = nat_garbage_collector file = nexus/src/app/background/tasks/nat_cleanup.rs:89
148502026-10-29T02:52:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
148512026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 15.518663ms iteration = 29 status = {"error":"dendrite for switch1 is unavailable, cannot perform nat cleanup"}
148522026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
148532026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
148542026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
148552026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
148562026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
148572026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
148582026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
148592026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
148602026-10-29T02:52:33.742ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148612026-10-29T02:52:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
148622026-10-29T02:52:33.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148632026-10-29T02:52:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
148642026-10-29T02:52:33.743ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
148652026-10-29T02:52:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
148662026-10-29T02:52:33.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148672026-10-29T02:52:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
148682026-10-29T02:52:33.746ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148692026-10-29T02:52:33.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148702026-10-29T02:52:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
148712026-10-29T02:52:33.747ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
148722026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
148732026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Fleet result = Ok(()) slot = 0 sp_type = switch
148742026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 roles = RoleSet { roles: {} } slot = 0 sp_type = switch
148752026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = sp_ereport_ingester ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 resource = Database result = Ok(()) slot = 0 sp_type = switch
148762026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
148772026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
148782026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
148792026-10-29T02:52:33.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
148802026-10-29T02:52:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
148812026-10-29T02:52:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
148822026-10-29T02:52:33.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148832026-10-29T02:52:33.749ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 23.283044ms iteration = 15 status = {"dispatched":[],"errors":[],"glob_version":"311.0.0","globs_reprocessed":{},"no_receivers":[]}
148842026-10-29T02:52:33.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148852026-10-29T02:52:33.753ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
148862026-10-29T02:52:33.753ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 27.778257ms iteration = 169 status = {"config_updated":false}
148872026-10-29T02:52:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148882026-10-29T02:52:33.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
148892026-10-29T02:52:33.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148902026-10-29T02:52:33.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148912026-10-29T02:52:33.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
148922026-10-29T02:52:33.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Fleet result = Ok(())
148932026-10-29T02:52:33.755ZDEBGnexus (BackgroundTasks): roles background_task = capacity_metrics roles = RoleSet { roles: {} }
148942026-10-29T02:52:33.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = capacity_metrics resource = Database result = Ok(())
148952026-10-29T02:52:33.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.538568ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
148962026-10-29T02:52:33.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148972026-10-29T02:52:33.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
148982026-10-29T02:52:33.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.060202ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
148992026-10-29T02:52:33.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149002026-10-29T02:52:33.848ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149012026-10-29T02:52:33.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
149022026-10-29T02:52:33.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
149032026-10-29T02:52:33.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
149042026-10-29T02:52:33.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149052026-10-29T02:52:33.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
149062026-10-29T02:52:33.854ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
149072026-10-29T02:52:33.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
149082026-10-29T02:52:33.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
149092026-10-29T02:52:33.864ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
149102026-10-29T02:52:33.864ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
149112026-10-29T02:52:33.864ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 138.028589ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
149122026-10-29T02:52:33.866ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149132026-10-29T02:52:33.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149142026-10-29T02:52:33.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149152026-10-29T02:52:33.868ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149162026-10-29T02:52:33.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 143.331259ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
149172026-10-29T02:52:33.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
149182026-10-29T02:52:33.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
149192026-10-29T02:52:33.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
149202026-10-29T02:52:33.872ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 original_time_started = 2026-10-29 02:51:34.941486 UTC
149212026-10-29T02:52:33.872ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 146.341352ms iteration = 74 status = {"Loaded":{"collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","time_loaded":"2026-10-29T02:52:33.725914656Z","time_started":"2026-10-29T02:51:34.941486Z"}}
149222026-10-29T02:52:33.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
149232026-10-29T02:52:33.874ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
149242026-10-29T02:52:33.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
149252026-10-29T02:52:33.878ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 152.722894ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
149262026-10-29T02:52:33.878ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Psc rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = d2f05cb3-a876-4fe6-98b4-0c2a44b90716 (ereporter_restart) slot = 1 sp_type = sled start_ena = Some(Ena(0x2))
149272026-10-29T02:52:33.878ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2
149282026-10-29T02:52:33.879ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?committed=1&limit=255&restart_id=d2f05cb3-a876-4fe6-98b4-0c2a44b90716&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bbcf29b-8a9e-49a4-ae56-538e5f73c4e9", "content-length": "81", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} })
149292026-10-29T02:52:33.881ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
149302026-10-29T02:52:33.881ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 155.766748ms iteration = 57 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
149312026-10-29T02:52:33.881ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
149322026-10-29T02:52:33.882ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 156.144045ms iteration = 59 status = {"Loaded":{"time_loaded":"2026-10-29T02:52:33.725864695Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
149332026-10-29T02:52:33.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
149342026-10-29T02:52:33.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149352026-10-29T02:52:33.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149362026-10-29T02:52:33.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
149372026-10-29T02:52:33.886ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149382026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
149392026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
149402026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149412026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149422026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
149432026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149442026-10-29T02:52:33.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
149452026-10-29T02:52:33.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
149462026-10-29T02:52:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
149472026-10-29T02:52:33.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149482026-10-29T02:52:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
149492026-10-29T02:52:33.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
149502026-10-29T02:52:33.892ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
149512026-10-29T02:52:33.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
149522026-10-29T02:52:33.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149532026-10-29T02:52:33.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
149542026-10-29T02:52:33.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
149552026-10-29T02:52:33.895ZDEBGnexus (BackgroundTasks): activation complete background_task = capacity_metrics elapsed = 163.280244ms iteration = 15 status = {"samples_queued":6}
149562026-10-29T02:52:33.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
149572026-10-29T02:52:33.897ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
149582026-10-29T02:52:33.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149592026-10-29T02:52:33.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149602026-10-29T02:52:33.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149612026-10-29T02:52:33.899ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
149622026-10-29T02:52:33.899ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
149632026-10-29T02:52:33.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
149642026-10-29T02:52:33.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
149652026-10-29T02:52:33.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149662026-10-29T02:52:33.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
149672026-10-29T02:52:33.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149682026-10-29T02:52:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149692026-10-29T02:52:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
149702026-10-29T02:52:33.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
149712026-10-29T02:52:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
149722026-10-29T02:52:33.913ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149732026-10-29T02:52:33.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 190.338206ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
149742026-10-29T02:52:33.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
149752026-10-29T02:52:33.919ZDEBGnexus (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
149762026-10-29T02:52:33.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
149772026-10-29T02:52:33.922ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = 62ff4941-4086-4fb5-aec1-de0aee48c361 (ereporter_restart) slot = 0 sp_type = sled start_ena = Some(Ena(0x2))
149782026-10-29T02:52:33.922ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2
149792026-10-29T02:52:33.923ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?committed=1&limit=255&restart_id=62ff4941-4086-4fb5-aec1-de0aee48c361&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a0dd5cd-0a01-49d0-8e7e-37dfe8d56e4e", "content-length": "81", "date": "Thu, 29 Oct 2026 02:52:33 GMT"} })
149802026-10-29T02:52:33.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
149812026-10-29T02:52:33.952ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
149822026-10-29T02:52:33.952ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
149832026-10-29T02:52:33.952ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
149842026-10-29T02:52:33.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
149852026-10-29T02:52:33.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
149862026-10-29T02:52:33.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
149872026-10-29T02:52:33.960ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
149882026-10-29T02:52:33.960ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
149892026-10-29T02:52:33.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
149902026-10-29T02:52:33.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_updater resource = Database result = Ok(())
149912026-10-29T02:52:33.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149922026-10-29T02:52:33.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149932026-10-29T02:52:33.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149942026-10-29T02:52:33.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149952026-10-29T02:52:33.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
149962026-10-29T02:52:33.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
149972026-10-29T02:52:33.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:777 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
149982026-10-29T02:52:33.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 243.260996ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
149992026-10-29T02:52:33.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150002026-10-29T02:52:33.974ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150012026-10-29T02:52:33.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
150022026-10-29T02:52:33.980ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
150032026-10-29T02:52:33.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
150042026-10-29T02:52:33.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
150052026-10-29T02:52:33.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150062026-10-29T02:52:33.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150072026-10-29T02:52:33.982ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150082026-10-29T02:52:33.983ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
150092026-10-29T02:52:33.983ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 257.486572ms iteration = 85 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
150102026-10-29T02:52:33.986ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150112026-10-29T02:52:33.986ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
150122026-10-29T02:52:33.992ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
150132026-10-29T02:52:33.992ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
150142026-10-29T02:52:33.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150152026-10-29T02:52:33.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150162026-10-29T02:52:33.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
150172026-10-29T02:52:33.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
150182026-10-29T02:52:33.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
150192026-10-29T02:52:34.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150202026-10-29T02:52:34.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 279.515119ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
150212026-10-29T02:52:34.008ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
150222026-10-29T02:52:34.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
150232026-10-29T02:52:34.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
150242026-10-29T02:52:34.012ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: b4d33e9e-d36f-4460-9898-1402e863f8ab, kind: Service { id: 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 }, name: Name("ntp-1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42"), ip_config: V4(PrivateIpv4Config { ip: 172.30.3.5, subnet: Ipv4Net { addr: 172.30.3.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 245])), vni: Vni(100), primary: true, slot: 0 } zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 zone_kind = boundary_ntp
150252026-10-29T02:52:34.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
150262026-10-29T02:52:34.016ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
150272026-10-29T02:52:34.016ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
150282026-10-29T02:52:34.016ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
150292026-10-29T02:52:34.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
150302026-10-29T02:52:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
150312026-10-29T02:52:34.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
150322026-10-29T02:52:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
150332026-10-29T02:52:34.020ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
150342026-10-29T02:52:34.020ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
150352026-10-29T02:52:34.020ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 288.406314ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
150362026-10-29T02:52:34.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150372026-10-29T02:52:34.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150382026-10-29T02:52:34.025ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
150392026-10-29T02:52:34.032ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
150402026-10-29T02:52:34.032ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
150412026-10-29T02:52:34.032ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2026-10-29 02:39:05.964215 UTC dns_group = internal generation = 1
150422026-10-29T02:52:34.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 300.562358ms iteration = 15 status = {"generation":1}
150432026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
150442026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
150452026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
150462026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = Some(Ena(0x1)) gateway_addr = [fd00:1122:3344:101::2]:12225 ignition_type = Gimlet rack_id = f1e8ed04-7806-4028-b390-384c79e98514 restart_id = ad275ba0-efe2-4ad4-9b1a-c181858c2c7c (ereporter_restart) slot = 0 sp_type = switch start_ena = Some(Ena(0x2))
150472026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST operation_id = sp_ereports_ingest uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2
150482026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
150492026-10-29T02:52:34.034ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
150502026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
150512026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_ereports_ingest result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?committed=1&limit=255&restart_id=ad275ba0-efe2-4ad4-9b1a-c181858c2c7c&start_at=2", status: 200, headers: {"content-type": "application/json", "x-request-id": "876e5046-ee05-4978-80a4-a69b91549277", "content-length": "81", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
150522026-10-29T02:52:34.034ZDEBGnexus (BackgroundTasks): ingested 0 (0 new) ereports from 3 service processors in 1 racks absent_sps = 1 background_task = sp_ereport_ingester new_ereports = 0 racks = 1 total_ereports = 0
150532026-10-29T02:52:34.035ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 308.412051ms iteration = 29 status = {"disabled":false,"errors":[],"sps":[{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"psc"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":1,"sp_type":"sled"},{"ereports_received":0,"errors":[],"ignition_type":{"system_type":"gimlet"},"new_ereports":0,"rack_id":"f1e8ed04-7806-4028-b390-384c79e98514","requests":1,"slot":0,"sp_type":"switch"}],"sps_found":3,"sps_not_present":1}
150542026-10-29T02:52:34.037ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 } zone_id = 4023fafc-cd1a-40d6-ad67-87a7978f5d4e zone_kind = external_dns
150552026-10-29T02:52:34.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
150562026-10-29T02:52:34.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
150572026-10-29T02:52:34.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150582026-10-29T02:52:34.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150592026-10-29T02:52:34.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150602026-10-29T02:52:34.046ZDEBGnexus (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
150612026-10-29T02:52:34.047ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 726226925 } })
150622026-10-29T02:52:34.048ZINFOnexus (BackgroundTasks): will not update bootstore: it is up to date background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:610 rack_id = f1e8ed04-7806-4028-b390-384c79e98514
150632026-10-29T02:52:34.048ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 322.403821ms iteration = 29 status = {"incomplete_bootstore_configs":[]}
150642026-10-29T02:52:34.049ZDEBGnexus (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 322.594295ms iteration = 15 status = {"dendrite":{"ok":{"switch0":{"errors":[],"n_subnets_added":0,"n_subnets_removed":0,"n_total_subnets":0}}},"sled":{},"status":"listed"}
150652026-10-29T02:52:34.050ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
150662026-10-29T02:52:34.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
150672026-10-29T02:52:34.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
150682026-10-29T02:52:34.056ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
150692026-10-29T02:52:34.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150702026-10-29T02:52:34.059ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 } zone_id = 6505e49d-0b6f-4279-a03c-3c82a51480c9 zone_kind = nexus
150712026-10-29T02:52:34.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
150722026-10-29T02:52:34.061ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
150732026-10-29T02:52:34.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
150742026-10-29T02:52:34.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
150752026-10-29T02:52:34.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
150762026-10-29T02:52:34.065ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
150772026-10-29T02:52:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
150782026-10-29T02:52:34.068ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
150792026-10-29T02:52:34.068ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
150802026-10-29T02:52:34.068ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 342.513659ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
150812026-10-29T02:52:34.068ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
150822026-10-29T02:52:34.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
150832026-10-29T02:52:34.070ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
150842026-10-29T02:52:34.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
150852026-10-29T02:52:34.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150862026-10-29T02:52:34.074ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150872026-10-29T02:52:34.076ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
150882026-10-29T02:52:34.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
150892026-10-29T02:52:34.077ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
150902026-10-29T02:52:34.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
150912026-10-29T02:52:34.078ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
150922026-10-29T02:52:34.080ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 } zone_id = 7b10dfa6-18ea-42b2-8778-63328fd725a7 zone_kind = nexus
150932026-10-29T02:52:34.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
150942026-10-29T02:52:34.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
150952026-10-29T02:52:34.086ZINFOnexus (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager file = nexus/src/app/background/tasks/trust_quorum.rs:84
150962026-10-29T02:52:34.086ZDEBGnexus (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 360.558804ms iteration = 15 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
150972026-10-29T02:52:34.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150982026-10-29T02:52:34.097ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
150992026-10-29T02:52:34.100ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-10-29T02:38:31.376794Z, time_modified: 2026-10-29T02:38:31.376794Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, db_silo: Silo { identity: SiloIdentity { id: a878a4b9-bef9-4f8d-b405-9dcaf3650934, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2026-10-29T02:39:06.597539Z, time_modified: 2026-10-29T02:39:06.597539Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)), admin_group_name: None }, tls_certs: [TlsCertificate { digest: "aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8" }] }) }
151002026-10-29T02:52:34.100ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 373.935212ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]}},"default_endpoint":{"silo_id":"a878a4b9-bef9-4f8d-b405-9dcaf3650934","tls_certs":["aaa4de6f4476ad957debfe2aa454055c3a1c7509692a7317c5d2442fe45065d8"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
151012026-10-29T02:52:34.100ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
151022026-10-29T02:52:34.103ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 } zone_id = 97a05c7a-45f6-4478-90b7-92b3d6feea6d zone_kind = external_dns
151032026-10-29T02:52:34.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151042026-10-29T02:52:34.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151052026-10-29T02:52:34.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151062026-10-29T02:52:34.112ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
151072026-10-29T02:52:34.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
151082026-10-29T02:52:34.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
151092026-10-29T02:52:34.114ZINFOnexus (BackgroundTasks): found already-allocated external IP action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:396 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
151102026-10-29T02:52:34.114ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
151112026-10-29T02:52:34.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
151122026-10-29T02:52:34.116ZINFOnexus (BackgroundTasks): found already-allocated NIC action = allocate-external-networking background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/deployment/external_networking.rs:463 nic = NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 } zone_id = de03b714-4064-49aa-a33d-9fc25ec0bac9 zone_kind = nexus
151132026-10-29T02:52:34.116ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151142026-10-29T02:52:34.117ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = SledList step id = Fetch
151152026-10-29T02:52:34.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151162026-10-29T02:52:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151172026-10-29T02:52:34.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151182026-10-29T02:52:34.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
151192026-10-29T02:52:34.121ZDEBGnexus (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
151202026-10-29T02:52:34.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
151212026-10-29T02:52:34.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151222026-10-29T02:52:34.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151232026-10-29T02:52:34.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
151242026-10-29T02:52:34.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151252026-10-29T02:52:34.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 400.31038ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
151262026-10-29T02:52:34.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
151272026-10-29T02:52:34.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151282026-10-29T02:52:34.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151292026-10-29T02:52:34.131ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
151302026-10-29T02:52:34.131ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
151312026-10-29T02:52:34.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
151322026-10-29T02:52:34.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
151332026-10-29T02:52:34.132ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor body = Some(Body) method = PUT operation_id = probes_put uri = http://[fd00:1122:3344:101::1]:12345/probes
151342026-10-29T02:52:34.133ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = probe_distributor operation_id = probes_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/probes", status: 204, headers: {"x-request-id": "cb321018-de10-433e-b720-ec4ba2b4b005", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
151352026-10-29T02:52:34.133ZDEBGnexus (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
151362026-10-29T02:52:34.133ZINFOnexus (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor file = nexus/src/app/background/tasks/probe_distributor.rs:133 n_pushed_probes = 0
151372026-10-29T02:52:34.133ZDEBGnexus (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 407.058971ms iteration = 15 status = {"errors":[],"probes_by_sled":{"2beff0a4-76a3-42da-a94b-cd9b8774ad75":0}}
151382026-10-29T02:52:34.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151392026-10-29T02:52:34.134ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = DeployNexusRecords step id = Ensure
151402026-10-29T02:52:34.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151412026-10-29T02:52:34.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151422026-10-29T02:52:34.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
151432026-10-29T02:52:34.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
151442026-10-29T02:52:34.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
151452026-10-29T02:52:34.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151462026-10-29T02:52:34.144ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
151472026-10-29T02:52:34.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151482026-10-29T02:52:34.144ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
151492026-10-29T02:52:34.144ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
151502026-10-29T02:52:34.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151512026-10-29T02:52:34.145ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e320489-26c8-4313-b43c-8f8afac472db", "content-length": "372", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
151522026-10-29T02:52:34.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151532026-10-29T02:52:34.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151542026-10-29T02:52:34.146ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
151552026-10-29T02:52:34.146ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 420.364687ms iteration = 43 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
151562026-10-29T02:52:34.146ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
151572026-10-29T02:52:34.146ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
151582026-10-29T02:52:34.146ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2026-10-29 02:39:06.686509 UTC dns_group = external generation = 2
151592026-10-29T02:52:34.146ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 420.068191ms iteration = 15 status = {"generation":2}
151602026-10-29T02:52:34.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
151612026-10-29T02:52:34.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
151622026-10-29T02:52:34.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151632026-10-29T02:52:34.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
151642026-10-29T02:52:34.160ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
151652026-10-29T02:52:34.160ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
151662026-10-29T02:52:34.160ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "440edb14-da36-45de-853c-a5d70d8fced1", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
151672026-10-29T02:52:34.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151682026-10-29T02:52:34.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151692026-10-29T02:52:34.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151702026-10-29T02:52:34.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
151712026-10-29T02:52:34.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151722026-10-29T02:52:34.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
151732026-10-29T02:52:34.165ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
151742026-10-29T02:52:34.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
151752026-10-29T02:52:34.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151762026-10-29T02:52:34.168ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151772026-10-29T02:52:34.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151782026-10-29T02:52:34.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151792026-10-29T02:52:34.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
151802026-10-29T02:52:34.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
151812026-10-29T02:52:34.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
151822026-10-29T02:52:34.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
151832026-10-29T02:52:34.172ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
151842026-10-29T02:52:34.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
151852026-10-29T02:52:34.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151862026-10-29T02:52:34.173ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
151872026-10-29T02:52:34.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
151882026-10-29T02:52:34.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e190c69f-079a-4d28-b17b-8bb1aa3f22b2", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
151892026-10-29T02:52:34.173ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 447.970161ms iteration = 43 status = {}
151902026-10-29T02:52:34.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 44 reason = Dependency
151912026-10-29T02:52:34.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
151922026-10-29T02:52:34.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151932026-10-29T02:52:34.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151942026-10-29T02:52:34.174ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
151952026-10-29T02:52:34.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
151962026-10-29T02:52:34.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
151972026-10-29T02:52:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
151982026-10-29T02:52:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
151992026-10-29T02:52:34.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152002026-10-29T02:52:34.177ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152012026-10-29T02:52:34.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
152022026-10-29T02:52:34.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
152032026-10-29T02:52:34.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152042026-10-29T02:52:34.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152052026-10-29T02:52:34.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
152062026-10-29T02:52:34.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
152072026-10-29T02:52:34.182ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
152082026-10-29T02:52:34.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
152092026-10-29T02:52:34.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152102026-10-29T02:52:34.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152112026-10-29T02:52:34.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
152122026-10-29T02:52:34.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152132026-10-29T02:52:34.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152142026-10-29T02:52:34.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
152152026-10-29T02:52:34.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
152162026-10-29T02:52:34.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
152172026-10-29T02:52:34.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
152182026-10-29T02:52:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
152192026-10-29T02:52:34.190ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
152202026-10-29T02:52:34.190ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = None method = GET operation_id = list_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
152212026-10-29T02:52:34.191ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = list_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cc11147-40f2-45c0-9413-710232f51410", "content-length": "372", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
152222026-10-29T02:52:34.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152232026-10-29T02:52:34.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152242026-10-29T02:52:34.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152252026-10-29T02:52:34.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
152262026-10-29T02:52:34.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
152272026-10-29T02:52:34.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
152282026-10-29T02:52:34.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152292026-10-29T02:52:34.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
152302026-10-29T02:52:34.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
152312026-10-29T02:52:34.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
152322026-10-29T02:52:34.207ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager body = None method = GET operation_id = list_v2p uri = http://[fd00:1122:3344:101::1]:12345/v2p
152332026-10-29T02:52:34.207ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = v2p_manager operation_id = list_v2p result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f0f58be-e921-44a5-9d47-bdd55c919e56", "content-length": "691", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
152342026-10-29T02:52:34.207ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:119 interfaces = {} sled = sock
152352026-10-29T02:52:34.207ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:131 mappings = [] sled = sock
152362026-10-29T02:52:34.207ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:144 mappings = [] sled = sock
152372026-10-29T02:52:34.207ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.987463ms iteration = 29 status = {}
152382026-10-29T02:52:34.212ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
152392026-10-29T02:52:34.212ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_eip_gateways uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
152402026-10-29T02:52:34.213ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_eip_gateways result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "361dc944-9b9f-45fb-b816-9b40f859c0a8", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
152412026-10-29T02:52:34.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152422026-10-29T02:52:34.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152432026-10-29T02:52:34.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152442026-10-29T02:52:34.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152452026-10-29T02:52:34.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152462026-10-29T02:52:34.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152472026-10-29T02:52:34.227ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = SledAgent step id = Ensure
152482026-10-29T02:52:34.227ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup generation = 5 method = PUT operation_id = omicron_config_put sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 uri = http://[fd00:1122:3344:101::1]:12345/omicron-config
152492026-10-29T02:52:34.230ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup generation = 5 operation_id = omicron_config_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-config", status: 204, headers: {"x-request-id": "d89fc902-b8de-421c-a706-ec458f6f0e3a", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} }) sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
152502026-10-29T02:52:34.230ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = FirewallRules step id = Ensure
152512026-10-29T02:52:34.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152522026-10-29T02:52:34.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152532026-10-29T02:52:34.231ZINFOnexus (BackgroundTasks): VPC route manager sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
152542026-10-29T02:52:34.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager body = Some(Body) method = PUT operation_id = set_vpc_routes uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
152552026-10-29T02:52:34.232ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = vpc_route_manager operation_id = set_vpc_routes result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "71838ba0-30ef-4a54-9b45-8cb84dba0adb", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
152562026-10-29T02:52:34.232ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 58.385543ms iteration = 44 status = {}
152572026-10-29T02:52:34.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152582026-10-29T02:52:34.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152592026-10-29T02:52:34.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152602026-10-29T02:52:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152612026-10-29T02:52:34.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152622026-10-29T02:52:34.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152632026-10-29T02:52:34.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152642026-10-29T02:52:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152652026-10-29T02:52:34.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152662026-10-29T02:52:34.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152672026-10-29T02:52:34.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152682026-10-29T02:52:34.251ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
152692026-10-29T02:52:34.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
152702026-10-29T02:52:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
152712026-10-29T02:52:34.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152722026-10-29T02:52:34.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152732026-10-29T02:52:34.254ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152742026-10-29T02:52:34.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152752026-10-29T02:52:34.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152762026-10-29T02:52:34.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
152772026-10-29T02:52:34.258ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
152782026-10-29T02:52:34.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
152792026-10-29T02:52:34.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152802026-10-29T02:52:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152812026-10-29T02:52:34.262ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 536.117933ms iteration = 50 status = {"disks_added":0,"errors":[]}
152822026-10-29T02:52:34.263ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
152832026-10-29T02:52:34.263ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
152842026-10-29T02:52:34.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152852026-10-29T02:52:34.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
152862026-10-29T02:52:34.266ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152872026-10-29T02:52:34.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
152882026-10-29T02:52:34.269ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
152892026-10-29T02:52:34.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
152902026-10-29T02:52:34.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
152912026-10-29T02:52:34.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
152922026-10-29T02:52:34.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
152932026-10-29T02:52:34.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
152942026-10-29T02:52:34.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
152952026-10-29T02:52:34.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152962026-10-29T02:52:34.272ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
152972026-10-29T02:52:34.272ZINFOnexus (BackgroundTasks): building sitrep e6b5c42b-1c40-45c0-9084-ace33f21e44f (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = e6b5c42b-1c40-45c0-9084-ace33f21e44f (sitrep)
152982026-10-29T02:52:34.272ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = b5b18499-4f53-4cf9-869c-8c88985eb0e3 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
152992026-10-29T02:52:34.272ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 546.51981ms iteration = 33 status = {"inv_collection_id":"b5b18499-4f53-4cf9-869c-8c88985eb0e3","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:52:34.272361684Z","outcome":"Unchanged","start_time":"2026-10-29T02:52:34.272331864Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
153002026-10-29T02:52:34.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153012026-10-29T02:52:34.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153022026-10-29T02:52:34.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
153032026-10-29T02:52:34.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153042026-10-29T02:52:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153052026-10-29T02:52:34.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153062026-10-29T02:52:34.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153072026-10-29T02:52:34.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153082026-10-29T02:52:34.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153092026-10-29T02:52:34.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153102026-10-29T02:52:34.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153112026-10-29T02:52:34.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153122026-10-29T02:52:34.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153132026-10-29T02:52:34.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153142026-10-29T02:52:34.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
153152026-10-29T02:52:34.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153162026-10-29T02:52:34.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153172026-10-29T02:52:34.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153182026-10-29T02:52:34.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153192026-10-29T02:52:34.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153202026-10-29T02:52:34.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153212026-10-29T02:52:34.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153222026-10-29T02:52:34.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153232026-10-29T02:52:34.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153242026-10-29T02:52:34.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153252026-10-29T02:52:34.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
153262026-10-29T02:52:34.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153272026-10-29T02:52:34.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153282026-10-29T02:52:34.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
153292026-10-29T02:52:34.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153302026-10-29T02:52:34.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153312026-10-29T02:52:34.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153322026-10-29T02:52:34.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153332026-10-29T02:52:34.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153342026-10-29T02:52:34.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
153352026-10-29T02:52:34.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153362026-10-29T02:52:34.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153372026-10-29T02:52:34.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153382026-10-29T02:52:34.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153392026-10-29T02:52:34.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153402026-10-29T02:52:34.304ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
153412026-10-29T02:52:34.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153422026-10-29T02:52:34.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153432026-10-29T02:52:34.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153442026-10-29T02:52:34.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153452026-10-29T02:52:34.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153462026-10-29T02:52:34.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153472026-10-29T02:52:34.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153482026-10-29T02:52:34.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153492026-10-29T02:52:34.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153502026-10-29T02:52:34.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153512026-10-29T02:52:34.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153522026-10-29T02:52:34.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
153532026-10-29T02:52:34.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153542026-10-29T02:52:34.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153552026-10-29T02:52:34.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153562026-10-29T02:52:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153572026-10-29T02:52:34.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153582026-10-29T02:52:34.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153592026-10-29T02:52:34.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153602026-10-29T02:52:34.315ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:118 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
153612026-10-29T02:52:34.315ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 589.900171ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
153622026-10-29T02:52:34.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153632026-10-29T02:52:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
153642026-10-29T02:52:34.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
153652026-10-29T02:52:34.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153662026-10-29T02:52:34.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153672026-10-29T02:52:34.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153682026-10-29T02:52:34.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153692026-10-29T02:52:34.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
153702026-10-29T02:52:34.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
153712026-10-29T02:52:34.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153722026-10-29T02:52:34.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153732026-10-29T02:52:34.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153742026-10-29T02:52:34.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153752026-10-29T02:52:34.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153762026-10-29T02:52:34.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153772026-10-29T02:52:34.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153782026-10-29T02:52:34.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
153792026-10-29T02:52:34.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153802026-10-29T02:52:34.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153812026-10-29T02:52:34.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153822026-10-29T02:52:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153832026-10-29T02:52:34.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153842026-10-29T02:52:34.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153852026-10-29T02:52:34.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153862026-10-29T02:52:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153872026-10-29T02:52:34.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153882026-10-29T02:52:34.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153892026-10-29T02:52:34.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153902026-10-29T02:52:34.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153912026-10-29T02:52:34.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153922026-10-29T02:52:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153932026-10-29T02:52:34.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153942026-10-29T02:52:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153952026-10-29T02:52:34.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153962026-10-29T02:52:34.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
153972026-10-29T02:52:34.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
153982026-10-29T02:52:34.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
153992026-10-29T02:52:34.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154002026-10-29T02:52:34.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154012026-10-29T02:52:34.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154022026-10-29T02:52:34.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154032026-10-29T02:52:34.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154042026-10-29T02:52:34.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154052026-10-29T02:52:34.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000 (project), lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
154062026-10-29T02:52:34.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154072026-10-29T02:52:34.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154082026-10-29T02:52:34.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154092026-10-29T02:52:34.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154102026-10-29T02:52:34.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154112026-10-29T02:52:34.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154122026-10-29T02:52:34.384ZDEBGnexus (BackgroundTasks): resolved names for firewall rules background_task = blueprint_executor comment = initial blueprint from rack setup instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
154132026-10-29T02:52:34.384ZDEBGnexus (BackgroundTasks): resolved firewall rules for sled agents background_task = blueprint_executor comment = initial blueprint from rack setup sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f929df3-e072-40aa-91e9-72eb044d7b2e, kind: Service { id: 97a05c7a-45f6-4478-90b7-92b3d6feea6d }, name: Name("external-dns-97a05c7a-45f6-4478-90b7-92b3d6feea6d"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.5, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 48])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fe6716d1-73ea-4408-98c8-76641bffc1b8, kind: Service { id: 4023fafc-cd1a-40d6-ad67-87a7978f5d4e }, name: Name("external-dns-4023fafc-cd1a-40d6-ad67-87a7978f5d4e"), ip_config: V4(PrivateIpv4Config { ip: 172.30.1.6, subnet: Ipv4Net { addr: 172.30.1.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 134])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6962ec57-ccdd-4450-9767-e8dd6ece85e4, kind: Service { id: 6505e49d-0b6f-4279-a03c-3c82a51480c9 }, name: Name("nexus-6505e49d-0b6f-4279-a03c-3c82a51480c9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 122])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 72704c70-04b5-4e13-acfc-0bff8e57f4f7, kind: Service { id: 7b10dfa6-18ea-42b2-8778-63328fd725a7 }, name: Name("nexus-7b10dfa6-18ea-42b2-8778-63328fd725a7"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.7, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 149])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 911abab5-b97f-4276-a6d0-fb944d2c8988, kind: Service { id: de03b714-4064-49aa-a33d-9fc25ec0bac9 }, name: Name("nexus-de03b714-4064-49aa-a33d-9fc25ec0bac9"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.5, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 250])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
154142026-10-29T02:52:34.384ZDEBGnexus (BackgroundTasks): resolved 3 rules for sleds background_task = blueprint_executor comment = initial blueprint from rack setup
154152026-10-29T02:52:34.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
154162026-10-29T02:52:34.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154172026-10-29T02:52:34.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154182026-10-29T02:52:34.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154192026-10-29T02:52:34.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154202026-10-29T02:52:34.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154212026-10-29T02:52:34.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
154222026-10-29T02:52:34.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154232026-10-29T02:52:34.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154242026-10-29T02:52:34.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154252026-10-29T02:52:34.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154262026-10-29T02:52:34.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154272026-10-29T02:52:34.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
154282026-10-29T02:52:34.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154292026-10-29T02:52:34.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154302026-10-29T02:52:34.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154312026-10-29T02:52:34.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154322026-10-29T02:52:34.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154332026-10-29T02:52:34.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
154342026-10-29T02:52:34.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154352026-10-29T02:52:34.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154362026-10-29T02:52:34.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154372026-10-29T02:52:34.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154382026-10-29T02:52:34.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154392026-10-29T02:52:34.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
154402026-10-29T02:52:34.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154412026-10-29T02:52:34.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154422026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
154432026-10-29T02:52:34.468ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
154442026-10-29T02:52:34.468ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = beb756f1-6ab5-4acb-93fd-ea5392baa959 parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
154452026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154462026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): resolved sleds for vpc oxide-services background_task = blueprint_executor comment = initial blueprint from rack setup vpc_to_sled = [Sled { identity: SledIdentity { id: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), time_created: 2026-10-29T02:38:59.836466Z, time_modified: 2026-10-29T02:38:59.836466Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f1e8ed04-7806-4028-b390-384c79e98514 (rack), is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(137231454208)), reservoir_size: ByteCount(ByteCount(76059508736)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
154472026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): sending firewall rules to sled agents background_task = blueprint_executor comment = initial blueprint from rack setup
154482026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154492026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154502026-10-29T02:52:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154512026-10-29T02:52:34.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154522026-10-29T02:52:34.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154532026-10-29T02:52:34.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154542026-10-29T02:52:34.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
154552026-10-29T02:52:34.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
154562026-10-29T02:52:34.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
154572026-10-29T02:52:34.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154582026-10-29T02:52:34.476ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 2 limit = 5000 usage_percent = 0
154592026-10-29T02:52:34.476ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
154602026-10-29T02:52:34.476ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 750.799405ms iteration = 38 status = {"Unchanged":{"blueprint_count":2,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
154612026-10-29T02:52:34.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Sled { parent: Fleet, key: 2beff0a4-76a3-42da-a94b-cd9b8774ad75 (sled), lookup_type: ById(2beff0a4-76a3-42da-a94b-cd9b8774ad75) } result = Ok(())
154622026-10-29T02:52:34.476ZDEBGnexus (BackgroundTasks): client request SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor body = Some(Body) comment = initial blueprint from rack setup method = PUT operation_id = vpc_firewall_rules_put uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
154632026-10-29T02:52:34.477ZDEBGnexus (BackgroundTasks): client response SledAgent = 2beff0a4-76a3-42da-a94b-cd9b8774ad75 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = vpc_firewall_rules_put result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "15521b1d-1079-4877-bfea-21d8abde9349", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
154642026-10-29T02:52:34.477ZINFOnexus (BackgroundTasks): updated firewall rules on 1 sleds background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/networking/src/firewall_rules.rs:501
154652026-10-29T02:52:34.477ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = Dns step id = Ensure
154662026-10-29T02:52:34.477ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
154672026-10-29T02:52:34.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154682026-10-29T02:52:34.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154692026-10-29T02:52:34.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154702026-10-29T02:52:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154712026-10-29T02:52:34.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154722026-10-29T02:52:34.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
154732026-10-29T02:52:34.485ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal version = 1
154742026-10-29T02:52:34.485ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
154752026-10-29T02:52:34.485ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal
154762026-10-29T02:52:34.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154772026-10-29T02:52:34.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154782026-10-29T02:52:34.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154792026-10-29T02:52:34.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
154802026-10-29T02:52:34.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154812026-10-29T02:52:34.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154822026-10-29T02:52:34.493ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = internal
154832026-10-29T02:52:34.493ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
154842026-10-29T02:52:34.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154852026-10-29T02:52:34.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154862026-10-29T02:52:34.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154872026-10-29T02:52:34.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
154882026-10-29T02:52:34.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154892026-10-29T02:52:34.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154902026-10-29T02:52:34.501ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal dns_zone_id = 0f1564e5-347c-49ad-98a4-556f0d8f3df9 dns_zone_name = control-plane.oxide.internal found_so_far = 61 version = 1
154912026-10-29T02:52:34.501ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = internal nzones = 1 version = 1
154922026-10-29T02:52:34.501ZDEBGnexus (BackgroundTasks): reading DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
154932026-10-29T02:52:34.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154942026-10-29T02:52:34.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154952026-10-29T02:52:34.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
154962026-10-29T02:52:34.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
154972026-10-29T02:52:34.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154982026-10-29T02:52:34.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
154992026-10-29T02:52:34.509ZDEBGnexus (BackgroundTasks): found DNS version background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external version = 2
155002026-10-29T02:52:34.509ZDEBGnexus (BackgroundTasks): reading DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
155012026-10-29T02:52:34.509ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external
155022026-10-29T02:52:34.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155032026-10-29T02:52:34.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155042026-10-29T02:52:34.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155052026-10-29T02:52:34.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
155062026-10-29T02:52:34.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155072026-10-29T02:52:34.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155082026-10-29T02:52:34.516ZDEBGnexus (BackgroundTasks): found zones background_task = blueprint_executor comment = initial blueprint from rack setup count = 1 dns_group = external
155092026-10-29T02:52:34.516ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = blueprint_executor batch_size = 100 comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 0 version = 2
155102026-10-29T02:52:34.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155112026-10-29T02:52:34.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155122026-10-29T02:52:34.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155132026-10-29T02:52:34.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
155142026-10-29T02:52:34.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155152026-10-29T02:52:34.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155162026-10-29T02:52:34.524ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external dns_zone_id = d0733a72-f343-410d-b3e0-9ed714286844 dns_zone_name = oxide.test found_so_far = 4 version = 2
155172026-10-29T02:52:34.524ZDEBGnexus (BackgroundTasks): read DNS config background_task = blueprint_executor comment = initial blueprint from rack setup dns_group = external nzones = 1 version = 2
155182026-10-29T02:52:34.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155192026-10-29T02:52:34.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155202026-10-29T02:52:34.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155212026-10-29T02:52:34.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
155222026-10-29T02:52:34.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155232026-10-29T02:52:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155242026-10-29T02:52:34.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155252026-10-29T02:52:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155262026-10-29T02:52:34.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155272026-10-29T02:52:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155282026-10-29T02:52:34.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155292026-10-29T02:52:34.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = DnsConfig result = Ok(())
155302026-10-29T02:52:34.538ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns Internal comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
155312026-10-29T02:52:34.538ZINFOnexus (BackgroundTasks): no changes background_task = blueprint_executor blueprint_execution = dns External comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/dns.rs:249
155322026-10-29T02:52:34.538ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = OmicronZones step id = Cleanup
155332026-10-29T02:52:34.538ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = OmicronZones step id = Cleanup
155342026-10-29T02:52:34.538ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = PhysicalDisks step id = Cleanup
155352026-10-29T02:52:34.538ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = Clickhouse step id = Ensure
155362026-10-29T02:52:34.538ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = Clickhouse step id = Ensure
155372026-10-29T02:52:34.538ZDEBGnexus (BackgroundTasks): client request admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor body = None comment = initial blueprint from rack setup method = PUT operation_id = init_db uri = http://[fd00:1122:3344:101::e]:8888/init
155382026-10-29T02:52:34.543ZDEBGnexus (BackgroundTasks): client response admin_url = http://[fd00:1122:3344:101::e]:8888 background_task = blueprint_executor comment = initial blueprint from rack setup operation_id = init_db result = Ok(Response { url: "http://[fd00:1122:3344:101::e]:8888/init", status: 204, headers: {"x-request-id": "7d2ecafb-e6f7-4ad5-9344-7e5706517d1c", "date": "Thu, 29 Oct 2026 02:52:34 GMT"} })
155392026-10-29T02:52:34.543ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = SupportBundles step id = Cleanup
155402026-10-29T02:52:34.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155412026-10-29T02:52:34.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155422026-10-29T02:52:34.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155432026-10-29T02:52:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
155442026-10-29T02:52:34.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155452026-10-29T02:52:34.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155462026-10-29T02:52:34.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155472026-10-29T02:52:34.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155482026-10-29T02:52:34.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155492026-10-29T02:52:34.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = BlueprintConfig result = Ok(())
155502026-10-29T02:52:34.560ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = OmicronZones step id = Cleanup
155512026-10-29T02:52:34.560ZINFOnexus (SagaQuiesceHandle): starting saga re-assignment pass file = nexus/types/src/quiesce.rs:391
155522026-10-29T02:52:34.560ZDEBGnexus (BackgroundTasks): re-assign sagas: found expunged Nexus instances with matching generation background_task = blueprint_executor comment = initial blueprint from rack setup nexus_zone_ids = []
155532026-10-29T02:52:34.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155542026-10-29T02:52:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155552026-10-29T02:52:34.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155562026-10-29T02:52:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
155572026-10-29T02:52:34.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155582026-10-29T02:52:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155592026-10-29T02:52:34.607ZINFOnexus (BackgroundTasks): re-assigned sagas background_task = blueprint_executor comment = initial blueprint from rack setup count = 0 file = nexus/reconfigurator/execution/src/sagas.rs:67 nexus_zone_ids = []
155602026-10-29T02:52:34.607ZINFOnexus (SagaQuiesceHandle): saga re-assignment pass finished file = nexus/types/src/quiesce.rs:398 result = ReassignedAllAsOf(1664ff15-1011-4596-9b44-fd2dfd005b82 (blueprint), false)
155612026-10-29T02:52:34.607ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = OmicronZones step id = Cleanup
155622026-10-29T02:52:34.607ZINFOnexus (BackgroundTasks): abandon orphan sagas: abandoning running or unwinding sagas from expunged (and ready-for-cleanup) Nexus zones of an older generation than the current running Nexus zone background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:122 stale_expunged_sec_ids = []
155632026-10-29T02:52:34.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155642026-10-29T02:52:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155652026-10-29T02:52:34.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155662026-10-29T02:52:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Fleet result = Ok(())
155672026-10-29T02:52:34.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155682026-10-29T02:52:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155692026-10-29T02:52:34.706ZINFOnexus (BackgroundTasks): no orphaned sagas to abandon background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/reconfigurator/execution/src/sagas.rs:142
155702026-10-29T02:52:34.706ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = Cockroach step id = Ensure
155712026-10-29T02:52:34.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_executor comment = initial blueprint from rack setup roles = RoleSet { roles: {} }
155722026-10-29T02:52:34.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_executor comment = initial blueprint from rack setup resource = Database result = Ok(())
155732026-10-29T02:52:34.714ZINFOnexus (BackgroundTasks): set cockroachdb setting background_task = blueprint_executor comment = initial blueprint from rack setup file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:121 setting = cluster.preserve_downgrade_option value = 22.1
155742026-10-29T02:52:34.714ZDEBGnexus (UpdateEngine): start executing step background_task = blueprint_executor comment = initial blueprint from rack setup execution_id = ed7dfda0-98ab-43b5-8042-b6710cbf85c4 step component = MgsUpdates step id = Ensure
155752026-10-29T02:52:34.714ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 17 reason = Dependency
155762026-10-29T02:52:34.714ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 44 reason = Dependency
155772026-10-29T02:52:34.714ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
155782026-10-29T02:52:34.714ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
155792026-10-29T02:52:34.714ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 988.69308ms iteration = 16 status = {"enabled":true,"event_report":{"Ok":{"last_seen":16,"progress_events":[],"root_execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","step_events":[{"data":{"components":[{"component":"ExternalNetworking","total_component_steps":1},{"component":"SledList","total_component_steps":1},{"component":"DeployNexusRecords","total_component_steps":1},{"component":"SledAgent","total_component_steps":1},{"component":"FirewallRules","total_component_steps":1},{"component":"Dns","total_component_steps":1},{"component":"OmicronZones","total_component_steps":4},{"component":"PhysicalDisks","total_component_steps":1},{"component":"Clickhouse","total_component_steps":2},{"component":"SupportBundles","total_component_steps":1},{"component":"Cockroach","total_component_steps":1},{"component":"MgsUpdates","total_component_steps":1}],"first_step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"kind":"execution_started","steps":[{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1}]},"event_index":0,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":3000,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":390892905,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"ExternalNetworking","component_index":0,"description":"Ensure external networking resources","id":"Ensure","index":0,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":390892865,"secs":0}},"event_index":1,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":390907405,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":17470133,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledList","component_index":0,"description":"Fetch sled list","id":"Fetch","index":1,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":17470083,"secs":0}},"event_index":2,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":408393959,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":92713347,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"DeployNexusRecords","component_index":0,"description":"Ensure db_metadata_nexus_state records exist","id":"Ensure","index":2,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":92713297,"secs":0}},"event_index":3,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":501132636,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":3241327,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"SledAgent","component_index":0,"description":"Deploy sled configs","id":"Ensure","index":3,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":3241287,"secs":0}},"event_index":4,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":504391314,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":247078535,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"FirewallRules","component_index":0,"description":"Plumb service firewall rules","id":"Ensure","index":4,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":247078506,"secs":0}},"event_index":5,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":751478359,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":60426526,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Dns","component_index":0,"description":"Deploy DNS records","id":"Ensure","index":5,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":60426486,"secs":0}},"event_index":6,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":811913176,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":4610,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":0,"description":"Cleanup expunged zones","id":"Cleanup","index":6,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":4580,"secs":0}},"event_index":7,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":811929796,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2220,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":1,"description":"Decommission sleds","id":"Cleanup","index":7,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":2180,"secs":0}},"event_index":8,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":811934066,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":2630,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"PhysicalDisks","component_index":0,"description":"Decommission expunged disks","id":"Cleanup","index":8,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":2590,"secs":0}},"event_index":9,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":811937986,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":1940,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":0,"description":"Deploy clickhouse cluster nodes","id":"Ensure","index":9,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":1900,"secs":0}},"event_index":10,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":811941426,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":5350932,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Clickhouse","component_index":1,"description":"Deploy single-node clickhouse cluster","id":"Ensure","index":10,"total_component_steps":2},"metadata":null},"step_elapsed":{"nanos":5350892,"secs":0}},"event_index":11,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":817293458,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":16912031,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":"support bundle expunge report: SupportBundleExpungementReport { bundles_failed_missing_datasets: 0, bundles_deleted_missing_datasets: 0, bundles_failing_missing_nexus: 0, bundles_reassigned: 0 }","metadata":null},"step":{"info":{"component":"SupportBundles","component_index":0,"description":"Mark support bundles as failed if they rely on an expunged disk or sled","id":"Cleanup","index":11,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":16911981,"secs":0}},"event_index":12,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":834212889,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":47148989,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":2,"description":"Reassign sagas","id":"Cleanup","index":12,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":47148949,"secs":0}},"event_index":13,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":881379590,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":98499857,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"OmicronZones","component_index":3,"description":"Abandon orphan sagas","id":"Cleanup","index":13,"total_component_steps":4},"metadata":null},"step_elapsed":{"nanos":98499817,"secs":0}},"event_index":14,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":979892077,"secs":0}},{"data":{"attempt":1,"attempt_elapsed":{"nanos":8451786,"secs":0},"kind":"step_completed","next_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"outcome":{"kind":"success","message":null,"metadata":null},"step":{"info":{"component":"Cockroach","component_index":0,"description":"Ensure CockroachDB settings","id":"Ensure","index":14,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":8451746,"secs":0}},"event_index":15,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":988354483,"secs":0}},{"data":{"attempt_elapsed":{"nanos":5060,"secs":0},"kind":"execution_completed","last_attempt":1,"last_outcome":{"kind":"success","message":null,"metadata":null},"last_step":{"info":{"component":"MgsUpdates","component_index":0,"description":"Kick off MGS-managed updates","id":"Ensure","index":15,"total_component_steps":1},"metadata":null},"step_elapsed":{"nanos":5020,"secs":0}},"event_index":16,"execution_id":"ed7dfda0-98ab-43b5-8042-b6710cbf85c4","spec":"ReconfiguratorExecutionSpec","total_elapsed":{"nanos":988368623,"secs":0}}]}},"execution_error":null,"needs_saga_recovery":false,"target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82"}
155802026-10-29T02:52:34.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
155812026-10-29T02:52:34.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
155822026-10-29T02:52:34.716ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155832026-10-29T02:52:34.717ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155842026-10-29T02:52:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
155852026-10-29T02:52:34.720ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
155862026-10-29T02:52:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
155872026-10-29T02:52:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
155882026-10-29T02:52:34.720ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
155892026-10-29T02:52:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
155902026-10-29T02:52:34.722ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
155912026-10-29T02:52:34.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
155922026-10-29T02:52:34.723ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(d76d23d2-b342-49a2-a57b-b3d0258cc16c, 0), (bd0a7fbc-2166-40a8-ac88-d066673b1c53, 0), (6cd12faf-728b-4184-a999-7aceff377023, 0), (ad4b6167-0765-48de-9155-621a85ec60e2, 0)] collection_id = d76d23d2-b342-49a2-a57b-b3d0258cc16c
155932026-10-29T02:52:34.723ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
155942026-10-29T02:52:34.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
155952026-10-29T02:52:34.725ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155962026-10-29T02:52:34.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
155972026-10-29T02:52:34.728ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
155982026-10-29T02:52:34.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
155992026-10-29T02:52:34.778ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:375
156002026-10-29T02:52:34.778ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 63.416858ms iteration = 44 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
156012026-10-29T02:52:34.805ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = d76d23d2-b342-49a2-a57b-b3d0258cc16c file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 103 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
156022026-10-29T02:52:34.805ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
156032026-10-29T02:52:34.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
156042026-10-29T02:52:34.809ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(bd0a7fbc-2166-40a8-ac88-d066673b1c53, 0), (6cd12faf-728b-4184-a999-7aceff377023, 0), (ad4b6167-0765-48de-9155-621a85ec60e2, 0), (2df17221-9468-47c1-949e-9d2ab91a1ef7, 0)] collection_id = bd0a7fbc-2166-40a8-ac88-d066673b1c53
156052026-10-29T02:52:34.809ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
156062026-10-29T02:52:34.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
156072026-10-29T02:52:34.883ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = bd0a7fbc-2166-40a8-ac88-d066673b1c53 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 18 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 103 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 1 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 3 nlast_reconciliation_dataset_results = 84 nlast_reconciliation_disk_results = 9 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 28 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 1 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 84 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_external_ips = 6 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 npower_shelf_psus = 0 nrot_pages = 12 nrots = 3 nsled_agents = 1 nsps = 3 nsvcs_enabled_not_online = 1 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 9
156082026-10-29T02:52:34.883ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
156092026-10-29T02:52:34.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
156102026-10-29T02:52:34.893ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(6cd12faf-728b-4184-a999-7aceff377023, 0), (ad4b6167-0765-48de-9155-621a85ec60e2, 0), (2df17221-9468-47c1-949e-9d2ab91a1ef7, 0), (b5b18499-4f53-4cf9-869c-8c88985eb0e3, 0)] collection_id = 6cd12faf-728b-4184-a999-7aceff377023
156112026-10-29T02:52:34.893ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
156122026-10-29T02:52:34.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
156132026-10-29T02:52:35.005ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 6cd12faf-728b-4184-a999-7aceff377023 file = nexus/db-queries/src/db/datastore/inventory.rs:3024 nboot_partitions = 0 ncabooses = 0 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 0 nconfig_reconcilers = 0 ndatasets = 0 nerrors = 0 nfmd_host_cases = 0 nfmd_resources = 0 nfmd_status = 0 nhost_phase1_active_slots = 0 nhost_phase1_flash_hashes = 0 ninternal_dns = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_measurements = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_external_ips = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 npower_shelf_psus = 0 nrot_pages = 0 nrots = 0 nsled_agents = 0 nsps = 0 nsvcs_enabled_not_online = 0 nsvcs_enabled_not_online_error = 0 nsvcs_enabled_not_online_service = 0 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
156142026-10-29T02:52:35.005ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
156152026-10-29T02:52:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
156162026-10-29T02:52:35.008ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(ad4b6167-0765-48de-9155-621a85ec60e2, 0), (2df17221-9468-47c1-949e-9d2ab91a1ef7, 0), (b5b18499-4f53-4cf9-869c-8c88985eb0e3, 0)]
156172026-10-29T02:52:35.009ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-2beff0a4-76a3-42da-a94b-cd9b8774ad75.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1516, tv_nsec: 688102167 } })
156182026-10-29T02:52:35.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("82c8bfdc-ec02-4257-b53f-de579a21b7dd.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ba66b7c9-76fc-4b75-a97b-bab4bfa3f31f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c2874d2d-004a-49fb-89c9-9122b730207c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c55de21f-ab28-49e0-9c69-215749c65a15.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f0ee70e3-d328-449b-af97-bdec9ebac7c9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1516, tv_nsec: 689388014 } })
156192026-10-29T02:52:35.011ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
156202026-10-29T02:52:35.011ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
156212026-10-29T02:52:35.011ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = rack_id_get uri = http://[fd00:1122:3344:101::2]:12225/local/rack-id
156222026-10-29T02:52:35.012ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = rack_id_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/rack-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4885ccd-c2d4-4c1e-a9ba-74d4d9ce6a76", "content-length": "50", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156232026-10-29T02:52:35.012ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = ignition_list uri = http://[fd00:1122:3344:101::2]:12225/ignition
156242026-10-29T02:52:35.012ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = ignition_list result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "13cb9605-c662-4b3b-a1fe-1bed78f0965b", "content-length": "681", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156252026-10-29T02:52:35.012ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
156262026-10-29T02:52:35.012ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "815d2cef-7c30-4ee6-bcd2-b6ee0460a275", "content-length": "734", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156272026-10-29T02:52:35.012ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
156282026-10-29T02:52:35.013ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1f48054-7626-4960-b039-c813e40b937b", "content-length": "111", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156292026-10-29T02:52:35.013ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
156302026-10-29T02:52:35.014ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad93986c-7ff7-491a-b5c5-cdc26edfae53", "content-length": "111", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156312026-10-29T02:52:35.014ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
156322026-10-29T02:52:35.014ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1b1cc98-fa1f-48a3-8053-1e06b2fda7df", "content-length": "163", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156332026-10-29T02:52:35.014ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
156342026-10-29T02:52:35.015ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec68a3b3-cbc3-4e7c-ac94-b08e20adcae2", "content-length": "163", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156352026-10-29T02:52:35.015ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
156362026-10-29T02:52:35.015ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7af879bb-7c35-4b76-bb74-f9db789367ec", "content-length": "166", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156372026-10-29T02:52:35.015ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
156382026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "376bf90d-d137-4fa9-95b7-08b7c5311cda", "content-length": "166", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156392026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
156402026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea3402f2-0087-4ddd-9ae3-958e92bc8550", "content-length": "702", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156412026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
156422026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a5a1a93-2070-4030-aa6d-9fbc2fc338ed", "content-length": "727", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156432026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
156442026-10-29T02:52:35.016ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4230bf45-05da-429d-8d0e-883cdd3477b5", "content-length": "729", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156452026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
156462026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a9d8f89-3799-48cf-a368-aba12bee3933", "content-length": "728", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156472026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
156482026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f9e9044-b97b-460c-8edb-e33724d73642", "content-length": "722", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156492026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
156502026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2784c9a-7e35-43c1-89a6-ebeb0671ad12", "content-length": "10", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156512026-10-29T02:52:35.017ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
156522026-10-29T02:52:35.018ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "12b9d3f9-c310-4a04-98f2-693e77dacf5d", "content-length": "144", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156532026-10-29T02:52:35.018ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
156542026-10-29T02:52:35.018ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d3ee3a-b90a-42fd-8c75-79763825e112", "content-length": "147", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156552026-10-29T02:52:35.018ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
156562026-10-29T02:52:35.018ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f8f264b-9bfc-4e9f-8c6d-a0bbeb1357cc", "content-length": "109", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156572026-10-29T02:52:35.018ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
156582026-10-29T02:52:35.019ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a17becbb-01b6-40a7-b131-2701af313f7a", "content-length": "109", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156592026-10-29T02:52:35.019ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
156602026-10-29T02:52:35.019ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4c10335-f7ca-4b3f-bf15-645274326efa", "content-length": "163", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156612026-10-29T02:52:35.019ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
156622026-10-29T02:52:35.019ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a1e7248-e59b-48ab-b644-eef71d238c28", "content-length": "163", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156632026-10-29T02:52:35.020ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
156642026-10-29T02:52:35.020ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e875d2-cffa-450a-91b8-a1e625f84f7c", "content-length": "166", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156652026-10-29T02:52:35.020ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
156662026-10-29T02:52:35.020ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9289cdde-917a-4eca-9190-69edbea054c5", "content-length": "166", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156672026-10-29T02:52:35.020ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
156682026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc85d280-2bcf-4011-8897-977d9bd056e7", "content-length": "702", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156692026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
156702026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba8f60f7-1d4f-4afa-9d2f-fc023d6ffd19", "content-length": "727", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156712026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
156722026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c691b0-1c8b-45fe-9c5b-f17fdf15312f", "content-length": "729", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156732026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
156742026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2c5b75-c2ff-4c19-adf4-d4249c407030", "content-length": "728", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156752026-10-29T02:52:35.021ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1
156762026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "43398014-2948-402f-b207-08e169465a5d", "content-length": "722", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156772026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_active_slot_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot
156782026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_active_slot_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "b771a13c-d497-45f8-b19b-65c713b5b83d", "content-length": "10", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156792026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0
156802026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e026f3-0c51-489a-ad00-4084588934da", "content-length": "144", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156812026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_hash_firmware_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1
156822026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_hash_firmware_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "758d8692-ab83-4f27-be3c-a729a7eb54e6", "content-length": "147", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156832026-10-29T02:52:35.022ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0
156842026-10-29T02:52:35.023ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd589cc8-393a-49f2-8dea-ccbbd2d7f2ac", "content-length": "109", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156852026-10-29T02:52:35.023ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1
156862026-10-29T02:52:35.023ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "81541caa-477a-4903-91aa-c5d3ade7ef45", "content-length": "109", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156872026-10-29T02:52:35.023ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0
156882026-10-29T02:52:35.024ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5205b7a-933e-4c30-93d6-94dad17da10e", "content-length": "163", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156892026-10-29T02:52:35.024ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1
156902026-10-29T02:52:35.024ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a56f49eb-5d8f-46c9-bbbf-3bd28f58e32c", "content-length": "163", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156912026-10-29T02:52:35.024ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0
156922026-10-29T02:52:35.024ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef70dc57-f43b-4e92-a3ca-b46074dbfd08", "content-length": "166", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156932026-10-29T02:52:35.024ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_component_caboose_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1
156942026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_component_caboose_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "52524007-83fa-4a35-ac4f-67cf855b5c50", "content-length": "166", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156952026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cmpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa
156962026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cmpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37aba604-29a2-45fc-8305-3c9e94d29b9a", "content-length": "702", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156972026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
156982026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dce37817-5349-4f68-98b6-38f030ed2dec", "content-length": "727", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
156992026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
157002026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd7008bc-85e0-4299-84a5-8a3e27248921", "content-length": "729", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157012026-10-29T02:52:35.025ZDEBGnexus (BackgroundTasks): client request addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET operation_id = sp_rot_cfpa_get uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa
157022026-10-29T02:52:35.026ZDEBGnexus (BackgroundTasks): client response addr = [fd00:1122:3344:101::2]:12225 background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 operation_id = sp_rot_cfpa_get result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "824df3dd-144c-413e-a5fc-22d68ea98304", "content-length": "728", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157032026-10-29T02:52:35.026ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
157042026-10-29T02:52:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
157052026-10-29T02:52:35.028ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157062026-10-29T02:52:35.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
157072026-10-29T02:52:35.030ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
157082026-10-29T02:52:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
157092026-10-29T02:52:35.032ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157102026-10-29T02:52:35.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
157112026-10-29T02:52:35.034ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
157122026-10-29T02:52:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
157132026-10-29T02:52:35.037ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
157142026-10-29T02:52:35.037ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET operation_id = inventory uri = http://[fd00:1122:3344:101::1]:12345/inventory
157152026-10-29T02:52:35.127ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection operation_id = inventory result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbaae84d-5759-4e8d-b1b9-6741910f8adf", "content-length": "93890", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157162026-10-29T02:52:35.128ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
157172026-10-29T02:52:35.128ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
157182026-10-29T02:52:35.128ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
157192026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::7]:32222/node/id
157202026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::3]:32222/node/id
157212026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::5]:32222/node/id
157222026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::4]:32222/node/id
157232026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = local_node_id uri = http://[fd00:1122:3344:101::6]:32222/node/id
157242026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d37dfdd7-bbfc-42bd-b659-3a24de128767", "content-length": "64", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157252026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab4b748e-505a-48e2-9737-ec554b4b6c0c", "content-length": "64", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157262026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "963750fa-65e1-40ea-96a8-fb14c9ffaea5", "content-length": "64", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157272026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
157282026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
157292026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
157302026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4311e9e-d760-408a-a6c4-31bbfd619462", "content-length": "64", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157312026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
157322026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = local_node_id result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22bddce5-8ce5-4630-8e08-0ca432d9b9f7", "content-length": "64", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157332026-10-29T02:52:35.128ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET operation_id = status_vars uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
157342026-10-29T02:52:35.135ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "63574707-56c7-4dcc-be81-1a1c7ce9e7c5", "content-length": "423373", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157352026-10-29T02:52:35.135ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ef7c494-bb42-4222-ae05-b7b6d68bb1e5", "content-length": "423185", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157362026-10-29T02:52:35.135ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "92f6c48b-3acb-4e32-8bee-1d150f8d8040", "content-length": "426397", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157372026-10-29T02:52:35.136ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "986bcf7f-7420-4251-9a33-5b0fe13f827b", "content-length": "422267", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157382026-10-29T02:52:35.136ZDEBGnexus (CockroachClusterAdminClient): client response operation_id = status_vars result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "428bc447-b9a0-486b-9770-8264d58b899d", "content-length": "435758", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157392026-10-29T02:52:35.139ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
157402026-10-29T02:52:35.139ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
157412026-10-29T02:52:35.139ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
157422026-10-29T02:52:35.139ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
157432026-10-29T02:52:35.139ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
157442026-10-29T02:52:35.139ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 1b5d400b-82d3-4ed5-b3b2-ccc7c376fb42 (omicron_zone)
157452026-10-29T02:52:35.139ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync uri = http://[fd00:1122:3344:101::1b]:10123/timesync
157462026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 operation_id = timesync result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "a65db1bb-3ae5-47ae-bb13-982df188f11f", "content-length": "259", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157472026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
157482026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
157492026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:3::1]:5353/config
157502026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
157512026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
157522026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:2::1]:5353/config
157532026-10-29T02:52:35.143ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET operation_id = dns_config_get uri = http://[fd00:1122:3344:1::1]:5353/config
157542026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b394005-6c23-48cb-bdf5-f94cf68d3192", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157552026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f156d0ea-7458-458a-8545-355944cf75ad", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157562026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 operation_id = dns_config_get result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb2e1fa-a2b5-474b-8de4-75fd9e20610c", "content-length": "9713", "date": "Thu, 29 Oct 2026 02:52:35 GMT"} })
157572026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 87f1e945-be07-43ca-ad43-f1ca04fe351e (omicron_zone)
157582026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = bc6fcfc8-ca05-4d49-a942-5ee642c97444 (omicron_zone)
157592026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = d789e79f-8961-4aea-8010-d58ea7ccb3d2 (omicron_zone)
157602026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
157612026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
157622026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
157632026-10-29T02:52:35.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
157642026-10-29T02:52:35.146ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157652026-10-29T02:52:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
157662026-10-29T02:52:35.149ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
157672026-10-29T02:52:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
157682026-10-29T02:52:35.390ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 file = nexus/db-queries/src/db/datastore/inventory.rs:2241
157692026-10-29T02:52:35.390ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 time_started = 2026-10-29 02:52:35.011704 UTC
157702026-10-29T02:52:35.390ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 75 reason = Dependency
157712026-10-29T02:52:35.390ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
157722026-10-29T02:52:35.390ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 675.905838ms iteration = 17 status = {"collection_id":"2466f2bf-e141-42ff-8433-50657d1a4e27","time_done":"2026-10-29 02:52:35.144349 UTC","time_started":"2026-10-29 02:52:35.011704 UTC"}
157732026-10-29T02:52:35.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
157742026-10-29T02:52:35.392ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157752026-10-29T02:52:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
157762026-10-29T02:52:35.396ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
157772026-10-29T02:52:35.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
157782026-10-29T02:52:35.398ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
157792026-10-29T02:52:35.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
157802026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 69.968325ms iteration = 75 status = {"Loaded":{"collection_id":"2466f2bf-e141-42ff-8433-50657d1a4e27","time_loaded":"2026-10-29T02:52:35.390490063Z","time_started":"2026-10-29T02:52:35.011704Z"}}
157812026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 51 reason = Dependency
157822026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activating background_task = multicast_reconciler iteration = 37 reason = Dependency
157832026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 39 reason = Dependency
157842026-10-29T02:52:35.460ZINFOnexus (BackgroundTasks): multicast group reconciler not enabled background_task = multicast_reconciler file = nexus/src/app/background/tasks/multicast/mod.rs:453
157852026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activating background_task = fm_analysis iteration = 34 reason = Dependency
157862026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
157872026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
157882026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 21.41\u{b5}s iteration = 37 status = {"disabled":true,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
157892026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 26 reason = Dependency
157902026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
157912026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
157922026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
157932026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
157942026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
157952026-10-29T02:52:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
157962026-10-29T02:52:35.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157972026-10-29T02:52:35.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157982026-10-29T02:52:35.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
157992026-10-29T02:52:35.463ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158002026-10-29T02:52:35.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158012026-10-29T02:52:35.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158022026-10-29T02:52:35.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158032026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
158042026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
158052026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
158062026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
158072026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
158082026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
158092026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
158102026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
158112026-10-29T02:52:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
158122026-10-29T02:52:35.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158132026-10-29T02:52:35.468ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158142026-10-29T02:52:35.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
158152026-10-29T02:52:35.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
158162026-10-29T02:52:35.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158172026-10-29T02:52:35.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158182026-10-29T02:52:35.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158192026-10-29T02:52:35.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158202026-10-29T02:52:35.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158212026-10-29T02:52:35.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
158222026-10-29T02:52:35.472ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
158232026-10-29T02:52:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
158242026-10-29T02:52:35.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158252026-10-29T02:52:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
158262026-10-29T02:52:35.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
158272026-10-29T02:52:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158282026-10-29T02:52:35.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
158292026-10-29T02:52:35.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
158302026-10-29T02:52:35.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
158312026-10-29T02:52:35.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
158322026-10-29T02:52:35.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158332026-10-29T02:52:35.475ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
158342026-10-29T02:52:35.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
158352026-10-29T02:52:35.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
158362026-10-29T02:52:35.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
158372026-10-29T02:52:35.477ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158382026-10-29T02:52:35.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158392026-10-29T02:52:35.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158402026-10-29T02:52:35.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158412026-10-29T02:52:35.477ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
158422026-10-29T02:52:35.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158432026-10-29T02:52:35.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
158442026-10-29T02:52:35.478ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
158452026-10-29T02:52:35.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158462026-10-29T02:52:35.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
158472026-10-29T02:52:35.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158482026-10-29T02:52:35.480ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158492026-10-29T02:52:35.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
158502026-10-29T02:52:35.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
158512026-10-29T02:52:35.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
158522026-10-29T02:52:35.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158532026-10-29T02:52:35.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158542026-10-29T02:52:35.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158552026-10-29T02:52:35.483ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158562026-10-29T02:52:35.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
158572026-10-29T02:52:35.483ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
158582026-10-29T02:52:35.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
158592026-10-29T02:52:35.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158602026-10-29T02:52:35.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
158612026-10-29T02:52:35.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
158622026-10-29T02:52:35.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
158632026-10-29T02:52:35.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158642026-10-29T02:52:35.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158652026-10-29T02:52:35.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158662026-10-29T02:52:35.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158672026-10-29T02:52:35.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158682026-10-29T02:52:35.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158692026-10-29T02:52:35.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158702026-10-29T02:52:35.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158712026-10-29T02:52:35.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158722026-10-29T02:52:35.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158732026-10-29T02:52:35.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158742026-10-29T02:52:35.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158752026-10-29T02:52:35.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158762026-10-29T02:52:35.506ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:110 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
158772026-10-29T02:52:35.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158782026-10-29T02:52:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158792026-10-29T02:52:35.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158802026-10-29T02:52:35.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158812026-10-29T02:52:35.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158822026-10-29T02:52:35.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158832026-10-29T02:52:35.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158842026-10-29T02:52:35.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158852026-10-29T02:52:35.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158862026-10-29T02:52:35.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158872026-10-29T02:52:35.521ZINFOnexus (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_dataset.rs:145 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
158882026-10-29T02:52:35.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158892026-10-29T02:52:35.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158902026-10-29T02:52:35.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158912026-10-29T02:52:35.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158922026-10-29T02:52:35.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
158932026-10-29T02:52:35.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
158942026-10-29T02:52:35.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
158952026-10-29T02:52:35.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
158962026-10-29T02:52:35.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158972026-10-29T02:52:35.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
158982026-10-29T02:52:35.530ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
158992026-10-29T02:52:35.530ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159002026-10-29T02:52:35.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
159012026-10-29T02:52:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
159022026-10-29T02:52:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159032026-10-29T02:52:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
159042026-10-29T02:52:35.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
159052026-10-29T02:52:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
159062026-10-29T02:52:35.532ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159072026-10-29T02:52:35.533ZINFOnexus (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/local_storage_unencrypted_dataset.rs:149 num_already_exist = 9 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
159082026-10-29T02:52:35.533ZDEBGnexus (BackgroundTasks): activating background_task = vmm_mark_stop_for_update iteration = 25 reason = Dependency
159092026-10-29T02:52:35.533ZDEBGnexus (BackgroundTasks): roles background_task = vmm_mark_stop_for_update roles = RoleSet { roles: {} }
159102026-10-29T02:52:35.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 72.695581ms iteration = 26 status = {"blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","datasets":{"Reconciled":{"inventory_collection_id":"2466f2bf-e141-42ff-8433-50657d1a4e27","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}},"sled_blueprint_availability":{"Reconciled":{"num_already_decommissioned":0,"num_decommissioned":0,"num_decommissioned_not_in_blueprint":0,"num_invariant_violations":0,"num_marked_available":0,"num_marked_unavailable":0,"num_not_in_blueprint":0,"num_unchanged":1}}}
159112026-10-29T02:52:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_mark_stop_for_update resource = Database result = Ok(())
159122026-10-29T02:52:35.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
159132026-10-29T02:52:35.535ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159142026-10-29T02:52:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159152026-10-29T02:52:35.536ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 76.213334ms iteration = 51 status = {"disks_added":0,"errors":[]}
159162026-10-29T02:52:35.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159172026-10-29T02:52:35.538ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159182026-10-29T02:52:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159192026-10-29T02:52:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159202026-10-29T02:52:35.540ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159212026-10-29T02:52:35.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159222026-10-29T02:52:35.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
159232026-10-29T02:52:35.544ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159242026-10-29T02:52:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159252026-10-29T02:52:35.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
159262026-10-29T02:52:35.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159272026-10-29T02:52:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159282026-10-29T02:52:35.591ZDEBGnexus (BackgroundTasks): no VMMs need to be marked to stop for a sled update background_task = vmm_mark_stop_for_update
159292026-10-29T02:52:35.591ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_mark_stop_for_update elapsed = 58.104118ms iteration = 25 status = {"batch_size":1000,"batches":0,"error":null,"vmms_marked":0}
159302026-10-29T02:52:35.591ZDEBGnexus (BackgroundTasks): activating background_task = vmm_stop_for_update iteration = 40 reason = Dependency
159312026-10-29T02:52:35.591ZDEBGnexus (BackgroundTasks): roles background_task = vmm_stop_for_update roles = RoleSet { roles: {} }
159322026-10-29T02:52:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vmm_stop_for_update resource = Database result = Ok(())
159332026-10-29T02:52:35.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159342026-10-29T02:52:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159352026-10-29T02:52:35.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159362026-10-29T02:52:35.606ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159372026-10-29T02:52:35.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159382026-10-29T02:52:35.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
159392026-10-29T02:52:35.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159402026-10-29T02:52:35.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159412026-10-29T02:52:35.608ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159422026-10-29T02:52:35.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159432026-10-29T02:52:35.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159442026-10-29T02:52:35.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
159452026-10-29T02:52:35.611ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159462026-10-29T02:52:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159472026-10-29T02:52:35.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159482026-10-29T02:52:35.613ZDEBGnexus (BackgroundTasks): loaded 3 ereporter restarts (in 1 batches) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
159492026-10-29T02:52:35.613ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159502026-10-29T02:52:35.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159512026-10-29T02:52:35.615ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159522026-10-29T02:52:35.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
159532026-10-29T02:52:35.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159542026-10-29T02:52:35.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159552026-10-29T02:52:35.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Fleet result = Ok(())
159562026-10-29T02:52:35.618ZDEBGnexus (BackgroundTasks): roles background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) roles = RoleSet { roles: {} }
159572026-10-29T02:52:35.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) resource = Database result = Ok(())
159582026-10-29T02:52:35.623ZDEBGnexus (BackgroundTasks): loaded 0 ereports, 0 new background_task = fm_analysis inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
159592026-10-29T02:52:35.623ZINFOnexus (BackgroundTasks): building sitrep 057f9766-9abd-4a4a-bc42-05e28a403007 (sitrep) background_task = fm_analysis closed_cases_copied_forward = 0 existing_open_cases = 1 file = nexus/fm/src/builder.rs:83 inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 (collection) parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep)) sitrep_id = 057f9766-9abd-4a4a-bc42-05e28a403007 (sitrep)
159602026-10-29T02:52:35.623ZINFOnexus (BackgroundTasks): fault management analysis produced no changes from the current sitrep background_task = fm_analysis file = nexus/src/app/background/tasks/fm_analysis.rs:808 inv_collection_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 parent_sitrep_id = Some(c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep))
159612026-10-29T02:52:35.623ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_analysis elapsed = 163.487979ms iteration = 34 status = {"inv_collection_id":"2466f2bf-e141-42ff-8433-50657d1a4e27","known_classes":["hw.insert.psu","hw.remove.psu"],"outcome":{"RanAnalysis":{"analysis_status":{"capacity":null,"end_time":"2026-10-29T02:52:35.623933565Z","outcome":"Unchanged","start_time":"2026-10-29T02:52:35.623896404Z"},"prep_status":{"warnings":[]}}},"parent_sitrep_id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","warnings":[]}
159622026-10-29T02:52:35.657ZINFOnexus (BackgroundTasks): No VMMs were stopped for a sled update background_task = vmm_stop_for_update file = nexus/src/app/background/tasks/vmm_stop_for_update.rs:515
159632026-10-29T02:52:35.657ZDEBGnexus (BackgroundTasks): activation complete background_task = vmm_stop_for_update elapsed = 66.278738ms iteration = 40 status = {"error_messages":[],"vmms_failed_to_stop_by_sled":[],"vmms_stopped_by_sled":[]}
159642026-10-29T02:52:35.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159652026-10-29T02:52:35.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159662026-10-29T02:52:35.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159672026-10-29T02:52:35.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
159682026-10-29T02:52:35.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159692026-10-29T02:52:35.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159702026-10-29T02:52:35.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159712026-10-29T02:52:35.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159722026-10-29T02:52:35.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159732026-10-29T02:52:35.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPoolList result = Ok(())
159742026-10-29T02:52:35.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159752026-10-29T02:52:35.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159762026-10-29T02:52:35.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159772026-10-29T02:52:35.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159782026-10-29T02:52:35.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159792026-10-29T02:52:35.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = IpPool { parent: Fleet, key: 4fe66e8f-078a-4e0b-9d50-aef4b6729465, lookup_type: ById(4fe66e8f-078a-4e0b-9d50-aef4b6729465) } result = Ok(())
159802026-10-29T02:52:35.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159812026-10-29T02:52:35.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159822026-10-29T02:52:35.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159832026-10-29T02:52:35.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159842026-10-29T02:52:35.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159852026-10-29T02:52:35.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159862026-10-29T02:52:35.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159872026-10-29T02:52:35.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
159882026-10-29T02:52:35.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159892026-10-29T02:52:35.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159902026-10-29T02:52:35.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159912026-10-29T02:52:35.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159922026-10-29T02:52:35.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159932026-10-29T02:52:35.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = DnsConfig result = Ok(())
159942026-10-29T02:52:35.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159952026-10-29T02:52:35.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159962026-10-29T02:52:35.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
159972026-10-29T02:52:35.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
159982026-10-29T02:52:35.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
159992026-10-29T02:52:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
160002026-10-29T02:52:35.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160012026-10-29T02:52:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160022026-10-29T02:52:35.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160032026-10-29T02:52:35.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160042026-10-29T02:52:35.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160052026-10-29T02:52:35.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = TargetReleaseConfig result = Ok(())
160062026-10-29T02:52:35.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160072026-10-29T02:52:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160082026-10-29T02:52:35.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160092026-10-29T02:52:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160102026-10-29T02:52:35.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160112026-10-29T02:52:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
160122026-10-29T02:52:35.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160132026-10-29T02:52:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160142026-10-29T02:52:35.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160152026-10-29T02:52:35.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160162026-10-29T02:52:35.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160172026-10-29T02:52:35.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Fleet result = Ok(())
160182026-10-29T02:52:35.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160192026-10-29T02:52:35.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160202026-10-29T02:52:35.750ZDEBGnexus (BackgroundTasks): no mupdate override action taken, current value left unchanged background_task = blueprint_planner mupdate_override = None phase = do_plan_mupdate_override sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
160212026-10-29T02:52:35.750ZINFOnexus (BackgroundTasks): skipping noop image source check for all sleds background_task = blueprint_planner file = nexus/reconfigurator/planning/src/planner/image_source.rs:281 reason = no target release is currently set
160222026-10-29T02:52:35.750ZDEBGnexus (BlueprintBuilder): sled unchanged in new blueprint background_task = blueprint_planner blueprint_id = 14bd25c0-1455-4470-b16e-91919c20281c parent_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 sled_id = 2beff0a4-76a3-42da-a94b-cd9b8774ad75
160232026-10-29T02:52:35.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160242026-10-29T02:52:35.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160252026-10-29T02:52:35.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160262026-10-29T02:52:35.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = BlueprintConfig result = Ok(())
160272026-10-29T02:52:35.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_planner roles = RoleSet { roles: {} }
160282026-10-29T02:52:35.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_planner resource = Database result = Ok(())
160292026-10-29T02:52:35.759ZDEBGnexus (BackgroundTasks): blueprint count under limit, proceeding with planning background_task = blueprint_planner count = 2 limit = 5000 usage_percent = 0
160302026-10-29T02:52:35.759ZINFOnexus (BackgroundTasks): blueprint unchanged from current target background_task = blueprint_planner file = nexus/src/app/background/tasks/blueprint_planner.rs:268 parent_blueprint_id = 1664ff15-1011-4596-9b44-fd2dfd005b82
160312026-10-29T02:52:35.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 299.031046ms iteration = 39 status = {"Unchanged":{"blueprint_count":2,"limit":5000,"parent_blueprint_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","report":{"add":{"add_update_blocked_reasons":["sleds have deployment units with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75: 28 zones\\n","sleds have measurements with image sources not set to Artifact:\\n- sled 2beff0a4-76a3-42da-a94b-cd9b8774ad75 set to install dataset\\n"],"discretionary_zones_placed":{},"out_of_eligible_sleds":{"boundary_ntp":{"placed":0,"wanted_to_place":1}},"sleds_getting_ntp_and_discretionary_zones":[],"sleds_missing_crucible_zone":{},"sleds_missing_ntp_zone":[],"sleds_waiting_for_ntp_zone":[],"sleds_without_ntp_zones_in_inventory":[],"sleds_without_zpools_for_ntp_zones":[],"sufficient_zones_exist":{"clickhouse":{"num_existing":1,"target_count":1},"clickhouse_keeper":{"num_existing":0,"target_count":0},"clickhouse_server":{"num_existing":0,"target_count":0},"cockroach_db":{"num_existing":5,"target_count":5},"crucible_pantry":{"num_existing":3,"target_count":3},"external_dns":{"num_existing":2,"target_count":2},"internal_dns":{"num_existing":3,"target_count":3},"nexus":{"num_existing":3,"target_count":3},"oximeter":{"num_existing":1,"target_count":1}},"target_release_generation_is_one":true,"waiting_on":null},"cockroachdb_settings":{"preserve_downgrade":{"action":"set","data":"V22_1"}},"decommission":{"zombie_sleds":[]},"expunge":{"orphan_disks":{}},"measurement_updates":{"type":"blocked_add_update"},"mgs_updates":{"blocked_mgs_updates":[],"pending_mgs_updates":{"by_baseboard":[]},"update_disposition_changes":{}},"nexus_generation_bump":{"component":"nothing_to_report"},"noop_image_source":{"converted":{},"no_target_release":false,"skipped_sled_host_phase_2":{},"skipped_sled_measurements":{},"skipped_sled_zones":{},"skipped_zones":{},"sled_host_phase_2_both_already_artifact":[],"sled_measurements_already_artifact":[],"sled_zones_all_already_artifact":[]},"planner_config":{"disruption_policy":"terminate","sled_update_reboot_policy":"immediate_no_evacuation"},"zone_updates":{"expunged_zones":{},"out_of_date_zones":{},"unsafe_zones":{},"updated_zones":{},"waiting_on":{"type":"zone_add_blockers"},"waiting_zones":{}}}}}
160322026-10-29T02:52:38.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 170 reason = Timeout
160332026-10-29T02:52:38.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
160342026-10-29T02:52:38.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
160352026-10-29T02:52:38.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160362026-10-29T02:52:38.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
160372026-10-29T02:52:38.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
160382026-10-29T02:52:38.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
160392026-10-29T02:52:38.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
160402026-10-29T02:52:38.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.367243ms iteration = 170 status = {"config_updated":false}
160412026-10-29T02:52:40.620ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 206 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = 4a7ea571-2c33-4660-945b-5e1978620bf5 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
160422026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 171 reason = Timeout
160432026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
160442026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
160452026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
160462026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
160472026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
160482026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
160492026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
160502026-10-29T02:52:43.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
160512026-10-29T02:52:43.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160522026-10-29T02:52:43.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160532026-10-29T02:52:43.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
160542026-10-29T02:52:43.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
160552026-10-29T02:52:43.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.467233ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
160562026-10-29T02:52:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
160572026-10-29T02:52:43.732ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
160582026-10-29T02:52:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
160592026-10-29T02:52:43.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
160602026-10-29T02:52:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
160612026-10-29T02:52:43.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
160622026-10-29T02:52:43.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
160632026-10-29T02:52:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
160642026-10-29T02:52:43.735ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
160652026-10-29T02:52:43.735ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 9.541829ms iteration = 171 status = {"config_updated":false}
160662026-10-29T02:52:43.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160672026-10-29T02:52:43.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
160682026-10-29T02:52:43.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
160692026-10-29T02:52:43.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
160702026-10-29T02:52:43.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
160712026-10-29T02:52:43.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.103138ms iteration = 86 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}
160722026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 172 reason = Timeout
160732026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
160742026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_config_loader iteration = 58 reason = Timeout
160752026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
160762026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 60 reason = Timeout
160772026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
160782026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): activating background_task = inventory_loader iteration = 76 reason = Timeout
160792026-10-29T02:52:48.725ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
160802026-10-29T02:52:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
160812026-10-29T02:52:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
160822026-10-29T02:52:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
160832026-10-29T02:52:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
160842026-10-29T02:52:48.729ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160852026-10-29T02:52:48.729ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160862026-10-29T02:52:48.729ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160872026-10-29T02:52:48.731ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
160882026-10-29T02:52:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
160892026-10-29T02:52:48.734ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
160902026-10-29T02:52:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
160912026-10-29T02:52:48.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
160922026-10-29T02:52:48.735ZDEBGnexus (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
160932026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
160942026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
160952026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
160962026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = FmConfig result = Ok(())
160972026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): roles background_task = fm_config_loader roles = RoleSet { roles: {} }
160982026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
160992026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 10.890907ms iteration = 172 status = {"config_updated":false}
161002026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
161012026-10-29T02:52:48.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_config_loader resource = Database result = Ok(())
161022026-10-29T02:52:48.737ZDEBGnexus (BackgroundTasks): current sitrep has not changed background_task = fm_sitrep_loader original_id = c133a50c-e900-4e4f-a6bf-81a4b58b59b2 (sitrep) original_made_current = 2026-10-29 02:39:08.030898 UTC original_version = 2
161032026-10-29T02:52:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 11.749644ms iteration = 60 status = {"Loaded":{"time_loaded":"2026-10-29T02:52:48.725764357Z","version":{"id":"c133a50c-e900-4e4f-a6bf-81a4b58b59b2","time_made_current":"2026-10-29T02:39:08.030898Z","version":2}}}
161042026-10-29T02:52:48.738ZDEBGnexus (BackgroundTasks): latest inventory collection is unchanged background_task = inventory_loader original_id = 2466f2bf-e141-42ff-8433-50657d1a4e27 original_time_started = 2026-10-29 02:52:35.011704 UTC
161052026-10-29T02:52:48.738ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 12.856457ms iteration = 76 status = {"Loaded":{"collection_id":"2466f2bf-e141-42ff-8433-50657d1a4e27","time_loaded":"2026-10-29T02:52:48.725816168Z","time_started":"2026-10-29T02:52:35.011704Z"}}
161062026-10-29T02:52:48.738ZDEBGnexus (BackgroundTasks): FM config has not changed background_task = fm_config_loader source = default
161072026-10-29T02:52:48.738ZDEBGnexus (BackgroundTasks): activation complete background_task = fm_config_loader elapsed = 13.233825ms iteration = 58 status = {"Loaded":{"config":{"config":{"analysis_enabled":{"source":"default"},"certificate_expiry_warning_days":{"source":"default"},"history_pruning_threshold":{"source":"default"},"sitrep_limit":{"source":"default"}},"source":{"type":"default"}},"time_loaded":"2026-10-29T02:38:34.218770237Z","updated":false}}
161082026-10-29T02:52:49.187ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:1057 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:46402
161092026-10-29T02:52:49.187ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = 6d5ce2d3-22b8-4bb5-af3b-75f0a32954eb uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending version = 1.0.0
161102026-10-29T02:52:49.187ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = 6d5ce2d3-22b8-4bb5-af3b-75f0a32954eb roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
161112026-10-29T02:52:49.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = 6d5ce2d3-22b8-4bb5-af3b-75f0a32954eb resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
161122026-10-29T02:52:49.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 4129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = 6d5ce2d3-22b8-4bb5-af3b-75f0a32954eb response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?sort_by=id_ascending
161132026-10-29T02:52:49.191ZDEBGnexus (dropshot_internal): determined request API version local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = d97f74d7-de89-4ab9-a7fa-b11c92f5cb1a uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D version = 1.0.0
161142026-10-29T02:52:49.191ZDEBGnexus (dropshot_internal): roles authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = d97f74d7-de89-4ab9-a7fa-b11c92f5cb1a roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
161152026-10-29T02:52:49.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = d97f74d7-de89-4ab9-a7fa-b11c92f5cb1a resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
161162026-10-29T02:52:49.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 2979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46402 req_id = d97f74d7-de89-4ab9-a7fa-b11c92f5cb1a response_code = 200 uri = /metrics/collectors/8a46c129-dc41-46f0-b0fe-5dc9b5402b19/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTAzYjcxNC00MDY0LTQ5YWEtYTMzZC05ZmMyNWVjMGJhYzkifX0%3D
161172026-10-29T02:52:50.621ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:874 latency_us = 190 local_addr = [fd00:1122:3344:101::c]:47097 method = GET remote_addr = [fd00:1122:3344:101::d]:41784 req_id = bd611aaa-be83-47f0-b271-95646d9a7b71 response_code = 200 uri = /7b10dfa6-18ea-42b2-8778-63328fd725a7
161182026-10-29T02:52:53.725ZDEBGnexus (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 173 reason = Timeout
161192026-10-29T02:52:53.725ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
161202026-10-29T02:52:53.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
161212026-10-29T02:52:53.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
161222026-10-29T02:52:53.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
161232026-10-29T02:52:53.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
161242026-10-29T02:52:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
161252026-10-29T02:52:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
161262026-10-29T02:52:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
161272026-10-29T02:52:53.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
161282026-10-29T02:52:53.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
161292026-10-29T02:52:53.728ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
161302026-10-29T02:52:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
161312026-10-29T02:52:53.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.33214ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
161322026-10-29T02:52:53.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
161332026-10-29T02:52:53.731ZDEBGnexus (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
161342026-10-29T02:52:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
161352026-10-29T02:52:53.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
161362026-10-29T02:52:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
161372026-10-29T02:52:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
161382026-10-29T02:52:53.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
161392026-10-29T02:52:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
161402026-10-29T02:52:53.734ZDEBGnexus (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: true, planner_config: PlannerConfig { sled_update_reboot_policy: ImmediateNoEvacuation, disruption_policy: Terminate }, tuf_repo_pruner_enabled: true, blueprint_pruner_enabled: true, blueprint_pruner_nkeep: 1000 }, time_modified: 1970-01-01T00:01:01Z })
161412026-10-29T02:52:53.734ZDEBGnexus (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.408815ms iteration = 173 status = {"config_updated":false}
161422026-10-29T02:52:53.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
161432026-10-29T02:52:53.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1664ff15-1011-4596-9b44-fd2dfd005b82, lookup_type: ById(1664ff15-1011-4596-9b44-fd2dfd005b82) } result = Ok(())
161442026-10-29T02:52:53.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
161452026-10-29T02:52:53.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
161462026-10-29T02:52:53.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 original_time_created = 2026-10-29 02:36:29.448363 UTC target_id = 1664ff15-1011-4596-9b44-fd2dfd005b82 time_created = 2026-10-29 02:36:29.448363 UTC
161472026-10-29T02:52:53.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.318371ms iteration = 87 status = {"enabled":true,"status":"target blueprint unchanged","target_id":"1664ff15-1011-4596-9b44-fd2dfd005b82","time_created":"2026-10-29T02:36:29.448363Z"}